-- Logs begin at Mon 2022-06-27 08:39:53 UTC, end at Mon 2022-06-27 09:57:14 UTC. -- Jun 27 09:27:14.182195 dv-cinder-847730-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 27 09:27:14.193542 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 27 09:27:14.195659 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 27 09:27:14 2022] *** Jun 27 09:27:14.195659 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 27 09:27:14.195659 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 27 09:27:14.195659 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: nodename: dv-cinder-847730-1-iscsi Jun 27 09:27:14.195659 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: machine: x86_64 Jun 27 09:27:14.195659 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: clock source: unix Jun 27 09:27:14.195659 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: pcre jit disabled Jun 27 09:27:14.195659 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: detected number of CPU cores: 4 Jun 27 09:27:14.195659 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: current working directory: / Jun 27 09:27:14.195659 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: detected binary path: /usr/bin/uwsgi-core Jun 27 09:27:14.195659 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: your processes number limit is 47680 Jun 27 09:27:14.195659 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: your memory page size is 4096 bytes Jun 27 09:27:14.196462 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: detected max file descriptor number: 2048 Jun 27 09:27:14.196462 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: lock engine: pthread robust mutexes Jun 27 09:27:14.196462 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: thunder lock: enabled Jun 27 09:27:14.196462 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 27 09:27:14.196462 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 27 09:27:14.239425 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: Python main interpreter initialized at 0x55f88ff0c9c0 Jun 27 09:27:14.239425 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: python threads support enabled Jun 27 09:27:14.239425 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: your server socket listen backlog is limited to 100 connections Jun 27 09:27:14.239425 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: your mercy for graceful operations on workers is 90 seconds Jun 27 09:27:14.239827 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: mapped 403077 bytes (393 KB) for 2 cores Jun 27 09:27:14.239907 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: *** Operational MODE: preforking *** Jun 27 09:27:14.240131 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: *** uWSGI is running in multiple interpreter mode *** Jun 27 09:27:14.240131 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: spawned uWSGI master process (pid: 103894) Jun 27 09:27:14.240338 dv-cinder-847730-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 27 09:27:14.241393 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: spawned uWSGI worker 1 (pid: 103895, cores: 1) Jun 27 09:27:14.241393 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: spawned uWSGI worker 2 (pid: 103896, cores: 1) Jun 27 09:27:14.241393 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 27 09:27:14.910012 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 09:27:14.940171 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 09:27:16.038140 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 09:27:16.038140 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: from cryptography.utils import int_from_bytes Jun 27 09:27:16.038742 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 09:27:16.038742 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: from cryptography.utils import int_from_bytes Jun 27 09:27:16.063981 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 09:27:16.063981 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: from cryptography.utils import int_from_bytes Jun 27 09:27:16.064603 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 09:27:16.064603 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: from cryptography.utils import int_from_bytes Jun 27 09:27:18.578013 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 09:27:18.578706 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 09:27:18.578706 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 09:27:18.579055 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 09:27:18.579313 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 09:27:18.579734 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.579926 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 09:27:18.580274 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.580354 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 09:27:18.580452 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.580682 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.580793 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 09:27:18.581016 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.581109 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 09:27:18.581301 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 09:27:18.581387 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.581637 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.581730 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.581956 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.582041 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.582284 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.582369 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.582545 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.582641 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.582859 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.582953 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.583183 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847730-1-iscsi {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.583269 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.583502 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.583612 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.583837 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.583933 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.584152 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.584264 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.584457 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.584591 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.584766 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.584928 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.585087 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.585213 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847730-1-iscsi {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.585396 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.585522 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.585710 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.585892 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.586044 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.587036 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.587165 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.587282 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.587411 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.587411 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.587687 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.587687 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.587949 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.587949 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.588189 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.588310 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.588431 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.588562 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.588691 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.588937 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.589062 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.589196 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.589318 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.589449 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.589581 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.589712 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847730-1-iscsi {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.589836 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.589965 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.590088 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.590209 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.590336 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.590465 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.590599 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.590829 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.590976 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.591137 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.591259 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847730-1-iscsi {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.591446 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.591681 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.591826 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.591957 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.592103 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.592238 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.592412 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.592571 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.592739 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.592888 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.593060 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.593202 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.593379 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.593529 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.593698 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.593858 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.593992 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.594172 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.594297 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.594504 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.594629 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.594829 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.594963 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.595153 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.595316 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.595490 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.595645 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.595799 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.595938 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.596111 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.596244 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.596426 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.596551 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.596748 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.596879 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.597056 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.597179 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.597304 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.597424 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.597556 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.597689 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.597855 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.597987 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.598176 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.598318 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.598484 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.598619 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.598792 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.598917 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.599082 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.599216 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.599345 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.599475 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.599652 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.599774 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.599982 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.600118 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.600348 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.600474 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.600599 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.600729 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.600875 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.601064 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.601189 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.601316 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.601471 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.601595 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.601777 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.601901 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.602082 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.602205 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.602393 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.602521 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.602713 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.602838 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.603020 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.603145 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.603343 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.603479 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.603676 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.603802 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.603986 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.604120 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.604306 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.604445 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.604626 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.604765 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.604930 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.605060 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.605235 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.605369 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.605540 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.605667 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.605860 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.605985 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.606207 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.606338 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.606519 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.606642 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.606770 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.606900 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.607058 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.607184 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.607362 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.607487 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.607712 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.607838 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.608020 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.608148 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.608326 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.608458 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.608631 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.608761 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.608930 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.609054 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.609236 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.609359 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.609541 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.609664 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.609847 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.609974 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.610149 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.610274 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.610454 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.610592 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.610755 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.610878 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.611131 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.611264 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.611384 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.611514 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.611676 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.611801 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.611977 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.612116 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.612286 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.612438 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.612589 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.612712 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.612892 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.613018 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.613196 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.613330 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.613500 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.613633 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.613819 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.613942 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.614124 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.614263 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.614428 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.614553 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.614733 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.614856 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.615039 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.615173 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.615343 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.615482 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.615685 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.615821 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.615990 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.616194 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.616327 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.616448 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.616606 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.616729 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.616906 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.617038 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.617211 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.617335 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.617529 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.617659 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.617835 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.617966 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.618138 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.618262 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.618442 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.618568 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.618745 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.618879 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.619049 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.619174 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.619354 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.619479 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.619672 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.619795 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.619970 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.620096 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.620272 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.620408 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.620575 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.620700 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.620881 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.621013 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.621192 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.621329 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.621498 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.621599 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.622319 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.622461 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.622624 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.622752 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.622947 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.623039 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.623270 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.623358 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.623609 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.623795 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.623937 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.624073 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.624209 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.624335 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.624526 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:27:18.624668 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.624867 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.624993 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.625196 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.625320 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.625510 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.625638 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.625839 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.625964 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.626151 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.626297 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.626471 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.626596 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.626763 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.626889 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.627087 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.627220 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.627398 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.627522 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.627754 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.627928 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.628066 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.628201 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.628362 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.628510 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.628673 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.628801 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.628985 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.629193 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.629403 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.629608 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.629797 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.629925 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.630047 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.630175 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.630311 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.630434 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.630562 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.630726 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.630858 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.631002 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.631133 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.631255 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.631458 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.631616 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.631794 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.631932 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.632113 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.632294 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.632488 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.632687 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.632888 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.633031 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.633172 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.633295 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.633418 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.633539 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.633660 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.633799 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.633922 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.634045 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.634228 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.634353 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.634561 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.634703 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.634827 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.634962 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.635140 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.635272 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.635450 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.635613 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.635812 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.635941 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.636128 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.636254 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.636448 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.636607 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.636753 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.636876 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.637066 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.637193 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.637374 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.638117 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.638247 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.638378 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.638565 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.638690 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.638872 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.639005 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.639181 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.639300 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.639487 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.639731 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.639866 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.639989 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.640109 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.640230 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.640422 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.640556 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.640730 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.640862 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.641038 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.641163 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.641346 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.641495 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.641711 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.641838 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.641968 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.642090 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.649458 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.649703 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.649703 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.649895 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.649977 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.650074 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.650220 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.650309 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.650389 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.650477 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.650556 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.650633 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.650718 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.650797 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.650874 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.650955 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.651042 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.651120 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.651206 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.651295 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.651443 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.651604 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.651725 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.651808 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.651885 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.651952 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.652017 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.652082 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.652146 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.652223 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.652316 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.652449 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.652583 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.652708 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.652831 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.652965 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.653088 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.653207 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.653310 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.653412 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.653521 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.653632 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.653730 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.653827 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.653926 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.654027 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.654128 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.654241 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.654343 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.654444 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.654549 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.654670 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.654791 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.654896 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.655009 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.655138 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.655284 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.655392 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.655523 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.655671 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.655790 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.655906 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.656015 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.656135 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.656279 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.656404 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.656517 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.656659 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.656777 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.656893 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.657032 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.657132 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.657210 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.657276 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.657594 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.657683 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.657778 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.657858 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.657969 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.658103 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.658238 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.658388 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.658518 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.658653 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.658784 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.658923 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.659038 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.659132 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.659262 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.659401 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.659583 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.659741 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.659889 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.660033 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.660171 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.660312 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.660463 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.660603 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.660757 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.660896 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.661048 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.661191 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.661328 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.661468 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.661580 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.661661 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.661739 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.661825 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.661899 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.661964 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.662219 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.662318 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.662404 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.662483 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.662568 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.662648 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.662738 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.662824 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.662903 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.662979 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.663055 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.663145 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.663224 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.663309 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.663394 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.663472 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.663567 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.663673 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.663764 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.663855 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.663934 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.664011 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.664088 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.664173 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.664252 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.664336 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.664414 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.664491 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.664566 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.664655 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.664734 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.664818 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.664896 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.664973 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.665049 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.665133 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.665211 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.665288 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.665372 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.665445 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.665585 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.665668 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.665745 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.665821 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.665939 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.666058 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.666250 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.666371 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.666569 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.666691 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.666881 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.667004 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.667196 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.667324 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.667570 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.667660 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.667880 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.667967 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.668192 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.668280 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.668506 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.668593 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.668865 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.668985 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.669178 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.669272 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.669487 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.669576 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.669798 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.669894 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.670104 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.670188 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.670410 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.670506 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.670721 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.670815 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.671036 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.671122 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.671345 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.671430 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.671682 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.671786 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.671987 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.672121 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.672300 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.672428 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.672605 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.672700 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.672908 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.673002 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.673212 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.673297 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.673520 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.673606 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.673829 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.673914 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.674137 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.674221 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.674447 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.674532 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.674755 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.674841 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.675062 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.675154 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.675365 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.675459 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.675712 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.675802 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.676021 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.676109 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.676327 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.676423 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.676631 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.676717 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.676943 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.677080 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.677249 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.677341 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.677575 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.677659 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.677878 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.677981 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.678183 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.678275 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.678490 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.678576 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.678796 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.678888 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.679115 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.679200 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.679425 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.679510 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.679758 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.679858 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.680083 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.680168 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.680395 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.680482 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.680704 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.680793 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.681015 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.681103 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.681326 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.681422 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.681638 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.681734 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.681947 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.682043 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.682267 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.682399 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.682637 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.682725 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.682887 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.682996 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.683169 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.683259 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.683475 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.683587 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.683812 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.683899 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.684129 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.684230 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.684973 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.685242 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.685337 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.685577 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.685666 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.685883 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.685971 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.686197 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.686285 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.686514 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.686603 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.686833 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.687091 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.687211 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.687430 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.687518 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.687776 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.687918 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.688101 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.688229 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.688426 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.688540 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.688749 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.688834 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.689085 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.689176 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.689426 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.689527 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.689728 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.689825 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.690033 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.690135 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.690337 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.690425 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.690645 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.690747 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.690948 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.691043 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.691251 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.691340 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.691572 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.691663 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.691881 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.691970 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.692187 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.692283 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.692490 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.692623 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.692810 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.692904 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.693100 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.693277 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.693419 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.693559 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.693720 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.693867 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.694004 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.694136 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.694270 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.694400 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.694585 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.694680 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.694888 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.694974 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.695214 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.695317 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.695543 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.695645 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.695855 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.695955 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.696164 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.696260 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.696470 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.696556 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.696800 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.696888 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.697110 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.697207 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.697422 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.697540 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.697728 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.697840 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.698033 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.698148 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.698343 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.698462 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.698651 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.698771 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.698954 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.699068 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.699267 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.699354 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.699598 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.699690 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.699933 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.700029 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.700787 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.700882 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.701092 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.701179 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.701399 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.701492 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.701700 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.701784 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.702012 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.702106 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.702319 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.702405 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.702625 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.702746 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.702929 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.703026 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.703247 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.703373 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.703566 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.703662 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.703874 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.703978 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.704186 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.704273 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.704490 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.704575 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.704797 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.704897 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.705102 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.705187 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.705407 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.705501 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.705708 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.705803 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.706017 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.706110 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.706321 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.706408 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.706624 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.706710 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.706934 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.707019 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.707241 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.707328 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.707598 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.707697 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.707876 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.707961 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.708186 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.708280 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.708491 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.708586 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.708796 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.708883 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.709104 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.709249 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.709421 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.709508 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.709729 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.709816 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.710031 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.710124 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.710336 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.710420 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.710637 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.710721 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.710944 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.711043 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.711250 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.711336 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.711580 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.711668 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.711887 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.711989 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.712191 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.712286 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.712499 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.712624 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.712800 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.712883 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.713104 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.713190 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.713418 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.713516 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.713721 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.713807 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.714025 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.714110 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.714327 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.714412 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.714630 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.714717 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.714935 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.715019 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.715261 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.715352 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.715626 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.715774 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.715942 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.716034 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.716247 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.716392 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.716552 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.716642 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.716880 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.716964 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.717191 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.717287 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.717509 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.717597 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.717814 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.717908 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.718128 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.718222 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.718438 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.718525 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.718747 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.718839 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.719050 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.719149 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.719351 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.719443 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.719688 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.719794 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.719996 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.720091 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.720304 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.720400 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.720616 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.720701 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.720924 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.721019 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.721230 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.721320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.721534 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.721619 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.721842 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.721930 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.722151 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.722237 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.722458 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.722545 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.722766 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.722859 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.723073 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.723196 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.723381 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.723548 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.723720 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.723807 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.724028 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.724112 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.724333 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.724432 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.724639 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.724724 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.724943 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.725029 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.725252 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.725346 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.725559 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.725645 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.725863 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.725948 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.726175 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.726268 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.726492 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.726655 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.726777 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.726856 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.727086 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.727182 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.727391 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.727484 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.727722 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.727807 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.728027 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.728114 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.728364 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.728470 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.728677 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.728777 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.728990 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.729099 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.729299 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.729390 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.729616 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.729692 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.729930 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.730030 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.730263 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.730373 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.730577 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.730678 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.730877 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.730971 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.731801 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.731915 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.732119 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.732254 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.732426 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.732514 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.732741 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.732848 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.733043 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.733138 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.733350 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.733566 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.733706 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.733799 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.733969 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.734238 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.734489 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.734572 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.734660 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.734749 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.734879 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.734968 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.735228 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.735327 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.735465 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.735746 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.735848 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.735938 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.736226 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.736322 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.736532 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.736675 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.736925 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.737032 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.737250 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.737334 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.737548 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.737634 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.737874 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.738097 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.738958 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.739058 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.739127 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.739192 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.739366 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.739469 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.739828 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.739932 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.740003 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.740077 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.740157 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.740223 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.740296 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.740524 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.740623 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.740692 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.740757 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.740865 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.740976 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.741178 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.741271 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.741512 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.741617 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.741793 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.741880 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.742121 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.742216 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.742498 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.742651 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.742876 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.743088 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.743170 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.743281 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.743504 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.743601 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.743740 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.743871 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.744029 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.744128 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.744344 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.744583 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.744698 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.744795 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.745053 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.745181 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.745326 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.745487 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.745621 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.745760 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.745942 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.746088 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.746240 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.746341 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.746551 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.746659 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.746922 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.747663 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.747813 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.747940 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.748066 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.748203 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.748315 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.748438 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.748638 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.748737 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.748941 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.749030 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.749264 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.749340 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.749579 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.749683 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.749892 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.749969 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.750200 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.750286 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.750502 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.750609 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.750823 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.750929 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.751127 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.751220 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.751427 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.751514 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.751757 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.751851 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.752063 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.752194 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.752409 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.752508 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.752721 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.752827 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.753039 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.753147 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.753348 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.753445 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.753657 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.753798 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.753963 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.754100 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.754271 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.754358 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.754617 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.754733 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.754921 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.755036 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.755241 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.755338 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.755584 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.755703 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.755894 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.755989 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.756198 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.756292 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.756512 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.756611 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.756811 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.756920 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.757116 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.757203 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.757419 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.757506 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.757732 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.757837 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.758035 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.758142 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.758340 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.758446 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.758638 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.758744 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.758955 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.759068 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.759275 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.759452 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.759607 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.759741 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.759928 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.760069 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.760210 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.760345 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.760526 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.760714 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.760948 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.761090 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.761231 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.761391 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.761526 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.761660 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.761806 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.761942 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.762081 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.762331 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.762488 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.762628 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.762766 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.762914 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.763064 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.763206 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.763346 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.763485 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.763715 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.763924 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.764085 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.764276 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.764417 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.764558 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.764694 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.764832 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.764985 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.765131 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.765277 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.765418 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.765551 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.765696 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.765860 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.765985 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.766123 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.766283 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.766419 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.766681 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.766853 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.766987 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.767251 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.767390 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.767590 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.767745 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.767919 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.768065 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.768236 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.768458 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.768586 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.768783 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.768942 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.769146 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.769292 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.769529 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.769670 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.769818 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.770035 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.770178 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.770371 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.770511 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.770665 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.770805 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.770960 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.771104 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.771284 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.771431 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.771627 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.771763 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.771929 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.772062 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.772245 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.772389 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.772560 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.772706 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.772854 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.772987 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.773170 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.773325 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.773521 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.773653 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.773829 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.774067 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.774216 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.774397 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.774529 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.774738 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.774828 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.775047 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.775138 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.775357 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.775434 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.775693 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.775787 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.776009 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.776096 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.776322 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.776398 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.776632 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.776710 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.776946 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.777024 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.777260 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.777337 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.777585 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.777662 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.777905 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.777998 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.778257 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.778345 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.778572 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.778647 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.778886 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.778964 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.779200 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.779277 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.779521 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.779816 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.779918 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.780130 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.780207 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.780466 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.780543 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.780792 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.780869 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.781115 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.781198 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.781433 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.781510 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.781751 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.781826 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.782069 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.782146 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.782630 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.782711 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.782936 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.783192 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.783268 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.783509 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.783735 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.783859 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.783939 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.784180 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.784266 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.784490 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.784575 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.784794 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.784893 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.785114 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.785199 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.785424 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.785509 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.785735 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.785969 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.786056 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.786320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.786406 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.786660 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.786770 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.786942 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.787081 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.787265 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.787352 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.787611 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.787760 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.787923 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.788000 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.788245 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.788319 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.788553 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.788630 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.788858 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.789104 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.789205 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.789457 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.789549 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.789763 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.789855 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.790070 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.790168 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.790376 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.790461 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.790685 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.790826 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.790973 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.791085 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.791277 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.791421 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.791604 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.791711 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.791909 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.791997 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.792215 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.792306 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.792518 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.792642 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.792822 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.792912 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.793128 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.793214 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.793428 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.793513 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.794257 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.794352 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.794562 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.794648 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.794865 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.794951 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.795175 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.795307 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.795472 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.795590 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.795806 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.795895 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.796111 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.796215 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.796426 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.796567 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.796726 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.796829 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.797028 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.797124 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.797334 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.797421 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.797642 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.797729 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.797946 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.798042 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.798260 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.798355 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.798568 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.798655 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.798879 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.798965 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.799184 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.799270 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.799496 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.799689 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.799828 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.799924 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.800147 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.800266 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.800479 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.800566 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.800811 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.801067 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.801143 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.801411 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.801486 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.801728 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.801818 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.802043 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.802118 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.802368 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.802451 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.802685 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.802763 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.802994 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.803067 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.803304 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.803379 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.803725 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.803843 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.803964 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.804248 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.804376 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.804565 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.804685 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.804880 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.804994 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.805191 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.805312 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.805503 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.805625 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.805812 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.805925 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.806121 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.806234 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.806430 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.806553 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.806738 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.806851 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.807043 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.807159 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.807352 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.807466 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.807681 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.807800 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.807998 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.808124 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.808307 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.808420 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.808623 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.808739 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.808936 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.809037 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.809249 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.809350 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.810125 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.810237 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.810438 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.810543 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.810746 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.810832 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.811054 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.811141 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.811362 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.811460 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.811702 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.811803 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.812034 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.812121 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.812349 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.812437 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.812658 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.812750 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.812973 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.813092 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.813294 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.813392 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.813609 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.813695 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.813922 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.814010 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.814235 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.814323 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.814546 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.814632 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.814864 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.814962 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.815196 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.815355 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.815514 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.815658 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.815854 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.815955 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.816183 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.816341 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.816525 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.816660 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.816858 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.816985 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.817185 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.817310 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.817492 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.817625 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.817799 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.817953 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.818103 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.818280 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.818401 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.818594 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.818727 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.818918 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.819038 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.819232 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.819326 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.819597 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.819792 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.819932 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.820067 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.820241 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.820325 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.820546 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.820687 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.820852 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.820938 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.821157 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.821246 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.821463 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.821553 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.821764 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.821853 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.822067 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.822156 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.822360 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.822446 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.822658 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.822748 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.822960 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.823050 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.823262 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.823359 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.823588 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.823675 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.823892 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.823981 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.824196 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.824286 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.824495 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.824592 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.824798 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.824904 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.825144 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.825234 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.825449 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.825545 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.825756 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.825851 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.826061 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.826147 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.826367 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.826455 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.826673 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.826776 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.826984 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.827080 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.827289 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.827379 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.827618 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.827712 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.827926 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.828073 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.828232 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.828320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.828539 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.828623 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.828869 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.828954 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.829179 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.829267 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.829489 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.829586 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.829799 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.829887 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.830108 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.830199 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.830416 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.830513 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.830736 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.830903 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.831056 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.831207 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.831376 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.831463 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.831703 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.831803 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.832030 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.832126 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.832347 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.832441 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.832662 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.832750 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.832975 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.833073 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.833285 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.833378 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.833596 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.833681 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.833907 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.834003 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.834216 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.834304 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.834530 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.834627 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.834837 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.834927 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.835147 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.835250 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.835461 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.835611 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.835802 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.835898 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.836123 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.836208 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.836444 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.836534 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.836752 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.836841 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.837078 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.837170 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.837388 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.837481 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.837700 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.837786 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.838016 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.838105 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.838328 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.838426 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.838640 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.838725 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.838955 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.839031 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.839272 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.839368 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.839601 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.839689 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.839849 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 09:27:18.839938 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.840254 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.840627 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.840962 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.841318 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.841634 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.841983 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.842316 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.842637 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.842952 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.843264 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:27:18.843512 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 09:27:18.902371 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO dbcounter [None req-f652bb49-55ee-4e63-a3b0-f3693c342a33 None None] Registered counter for database nova_api Jun 27 09:27:18.998188 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO dbcounter [None req-667bace4-af08-4832-ab38-424074ac7e4a None None] Registered counter for database nova_api Jun 27 09:27:19.016823 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG oslo_db.sqlalchemy.engines [None req-f652bb49-55ee-4e63-a3b0-f3693c342a33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 09:27:19.018950 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG oslo_db.sqlalchemy.engines [None req-667bace4-af08-4832-ab38-424074ac7e4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 09:27:19.023547 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG dbcounter [-] [103896] Writer thread running {{(pid=103896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 09:27:19.025717 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG dbcounter [-] [103895] Writer thread running {{(pid=103895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 09:27:19.081355 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.context [None req-f652bb49-55ee-4e63-a3b0-f3693c342a33 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),75b3599f-e531-4aef-9894-8ae95c783344(cell1) {{(pid=103896) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 09:27:19.084590 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.context [None req-667bace4-af08-4832-ab38-424074ac7e4a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),75b3599f-e531-4aef-9894-8ae95c783344(cell1) {{(pid=103895) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 09:27:19.085304 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG oslo_concurrency.lockutils [None req-f652bb49-55ee-4e63-a3b0-f3693c342a33 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:27:19.086902 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG oslo_concurrency.lockutils [None req-f652bb49-55ee-4e63-a3b0-f3693c342a33 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:27:19.087742 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG oslo_concurrency.lockutils [None req-f652bb49-55ee-4e63-a3b0-f3693c342a33 None None] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:27:19.088556 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG oslo_concurrency.lockutils [None req-667bace4-af08-4832-ab38-424074ac7e4a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:27:19.089994 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG oslo_concurrency.lockutils [None req-f652bb49-55ee-4e63-a3b0-f3693c342a33 None None] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:27:19.090112 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG oslo_concurrency.lockutils [None req-667bace4-af08-4832-ab38-424074ac7e4a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:27:19.090967 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG oslo_concurrency.lockutils [None req-667bace4-af08-4832-ab38-424074ac7e4a None None] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:27:19.092078 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO dbcounter [None req-f652bb49-55ee-4e63-a3b0-f3693c342a33 None None] Registered counter for database nova_cell0 Jun 27 09:27:19.092959 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG oslo_concurrency.lockutils [None req-667bace4-af08-4832-ab38-424074ac7e4a None None] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:27:19.095004 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO dbcounter [None req-667bace4-af08-4832-ab38-424074ac7e4a None None] Registered counter for database nova_cell0 Jun 27 09:27:19.096081 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO dbcounter [None req-f652bb49-55ee-4e63-a3b0-f3693c342a33 None None] Registered counter for database nova_cell1 Jun 27 09:27:19.099138 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO dbcounter [None req-667bace4-af08-4832-ab38-424074ac7e4a None None] Registered counter for database nova_cell1 Jun 27 09:27:19.104607 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG oslo_db.sqlalchemy.engines [None req-f652bb49-55ee-4e63-a3b0-f3693c342a33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 09:27:19.106371 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG oslo_db.sqlalchemy.engines [None req-f652bb49-55ee-4e63-a3b0-f3693c342a33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 09:27:19.109742 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG oslo_db.sqlalchemy.engines [None req-667bace4-af08-4832-ab38-424074ac7e4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 09:27:19.111416 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG oslo_db.sqlalchemy.engines [None req-667bace4-af08-4832-ab38-424074ac7e4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 09:27:19.112625 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG dbcounter [-] [103896] Writer thread running {{(pid=103896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 09:27:19.114753 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG dbcounter [-] [103896] Writer thread running {{(pid=103896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 09:27:19.115348 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG dbcounter [-] [103895] Writer thread running {{(pid=103895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 09:27:19.122385 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG dbcounter [-] [103895] Writer thread running {{(pid=103895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 09:27:19.268994 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO dbcounter [None req-f652bb49-55ee-4e63-a3b0-f3693c342a33 None None] Registered counter for database nova_cell0 Jun 27 09:27:19.270850 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO dbcounter [None req-667bace4-af08-4832-ab38-424074ac7e4a None None] Registered counter for database nova_cell0 Jun 27 09:27:19.276926 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG oslo_db.sqlalchemy.engines [None req-f652bb49-55ee-4e63-a3b0-f3693c342a33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 09:27:19.280558 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG oslo_db.sqlalchemy.engines [None req-667bace4-af08-4832-ab38-424074ac7e4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 09:27:19.281555 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG dbcounter [-] [103896] Writer thread running {{(pid=103896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 09:27:19.285287 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG dbcounter [-] [103895] Writer thread running {{(pid=103895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 09:27:19.692901 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: WARNING keystonemiddleware.auth_token [None req-f652bb49-55ee-4e63-a3b0-f3693c342a33 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 09:27:19.700231 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: WARNING keystonemiddleware.auth_token [None req-f652bb49-55ee-4e63-a3b0-f3693c342a33 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 09:27:19.742838 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: WARNING keystonemiddleware.auth_token [None req-667bace4-af08-4832-ab38-424074ac7e4a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 09:27:19.750935 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: WARNING keystonemiddleware.auth_token [None req-667bace4-af08-4832-ab38-424074ac7e4a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 09:27:20.041219 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: WARNING keystonemiddleware.auth_token [None req-f652bb49-55ee-4e63-a3b0-f3693c342a33 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 09:27:20.047958 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: WARNING keystonemiddleware.auth_token [None req-f652bb49-55ee-4e63-a3b0-f3693c342a33 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 09:27:20.053288 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f88ff0c9c0 pid: 103896 (default app) Jun 27 09:27:20.055449 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-f652bb49-55ee-4e63-a3b0-f3693c342a33 None None] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:27:20.056676 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-f652bb49-55ee-4e63-a3b0-f3693c342a33 None None] 10.222.0.64 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001860 Jun 27 09:27:20.057078 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 788 bytes} [Mon Jun 27 09:27:20 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:27:20.097905 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: WARNING keystonemiddleware.auth_token [None req-667bace4-af08-4832-ab38-424074ac7e4a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 09:27:20.104036 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: WARNING keystonemiddleware.auth_token [None req-667bace4-af08-4832-ab38-424074ac7e4a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 09:27:20.109936 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f88ff0c9c0 pid: 103895 (default app) Jun 27 09:28:39.553750 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-f652bb49-55ee-4e63-a3b0-f3693c342a33 None None] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:28:39.554782 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-f652bb49-55ee-4e63-a3b0-f3693c342a33 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 27 09:28:39.555183 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 2/2] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 27 09:28:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:28:39.568638 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG dbcounter [-] [103895] Writing DB stats nova_api:SELECT=3 {{(pid=103895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:28:39.569886 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG dbcounter [-] [103895] Writing DB stats nova_cell0:SELECT=3 {{(pid=103895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:28:39.570611 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG dbcounter [-] [103895] Writing DB stats nova_cell1:SELECT=3 {{(pid=103895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:28:39.571702 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG dbcounter [-] [103895] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:28:40.005830 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-04dc09a3-065a-41e6-a9e3-df6812d44f16 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:28:40.035427 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-04dc09a3-065a-41e6-a9e3-df6812d44f16 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.472056 Jun 27 09:28:40.039682 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 1/3] 10.222.0.64 () {60 vars in 1291 bytes} [Mon Jun 27 09:28:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:28:42.111729 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-f652bb49-55ee-4e63-a3b0-f3693c342a33 None None] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:28:42.112814 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-f652bb49-55ee-4e63-a3b0-f3693c342a33 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 27 09:28:42.113206 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 3/4] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 27 09:28:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:28:42.174532 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-529fcdcf-3a11-4763-be15-751f2daf875a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "ram": 256, "id": "c1", "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:28:42.193552 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 09:28:42.193552 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: warnings.warn(msg) Jun 27 09:28:42.380834 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-529fcdcf-3a11-4763-be15-751f2daf875a admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.260742 Jun 27 09:28:42.382623 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 2/5] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jun 27 09:28:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 09:28:42.396625 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG dbcounter [-] [103896] Writing DB stats nova_api:SELECT=3 {{(pid=103896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:28:42.397459 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG dbcounter [-] [103896] Writing DB stats nova_cell1:SELECT=3 {{(pid=103896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:28:42.398639 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG dbcounter [-] [103896] Writing DB stats nova_cell0:SELECT=3 {{(pid=103896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:28:42.399359 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG dbcounter [-] [103896] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:28:42.606189 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-5ea619c3-c911-41e5-a206-26e848c731c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:28:42.608622 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 09:28:42.608622 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: warnings.warn(msg) Jun 27 09:28:42.755026 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-5ea619c3-c911-41e5-a206-26e848c731c6 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.363845 Jun 27 09:28:42.755817 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 4/6] 10.222.0.64 () {64 vars in 1335 bytes} [Mon Jun 27 09:28:42 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:28:44.865609 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-529fcdcf-3a11-4763-be15-751f2daf875a admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:28:44.866736 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-529fcdcf-3a11-4763-be15-751f2daf875a admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001605 Jun 27 09:28:44.867203 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 3/7] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 27 09:28:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:28:44.975800 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-05f5336e-90d7-4e5c-8812-4dee2b191508 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "vcpus": 1, "ram": 512, "id": "d1", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M"}} {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:28:44.993259 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 09:28:44.993259 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: warnings.warn(msg) Jun 27 09:28:45.113112 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-05f5336e-90d7-4e5c-8812-4dee2b191508 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.239733 Jun 27 09:28:45.114107 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 5/8] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jun 27 09:28:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 09:28:45.132856 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-604df977-1bff-4ee0-ad61-f9a4329c5501 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:28:45.137976 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 09:28:45.137976 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: warnings.warn(msg) Jun 27 09:28:45.259001 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-604df977-1bff-4ee0-ad61-f9a4329c5501 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129824 Jun 27 09:28:45.260121 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 4/9] 10.222.0.64 () {64 vars in 1335 bytes} [Mon Jun 27 09:28:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:28:47.369636 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-05f5336e-90d7-4e5c-8812-4dee2b191508 admin admin] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:28:47.370654 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-05f5336e-90d7-4e5c-8812-4dee2b191508 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jun 27 09:28:47.371268 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 6/10] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 27 09:28:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:28:47.433893 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-b6d5f0aa-b8f8-48fd-983b-69b897a62362 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "swap": 0, "ram": 1024, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:28:47.593081 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-b6d5f0aa-b8f8-48fd-983b-69b897a62362 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.215393 Jun 27 09:28:47.593547 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 5/11] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jun 27 09:28:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 09:28:47.605736 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-19c38ffd-aab4-41d9-854a-4ad3ba7521ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:28:47.733621 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-19c38ffd-aab4-41d9-854a-4ad3ba7521ec admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131758 Jun 27 09:28:47.734198 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 7/12] 10.222.0.64 () {64 vars in 1335 bytes} [Mon Jun 27 09:28:47 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:28:49.835381 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-b6d5f0aa-b8f8-48fd-983b-69b897a62362 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:28:49.836433 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-b6d5f0aa-b8f8-48fd-983b-69b897a62362 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 27 09:28:49.837010 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 6/13] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 27 09:28:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:28:49.905785 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-93e87e11-8379-47f7-9dfb-b905ec151ca0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "name": "ds2G", "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:28:50.023134 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-93e87e11-8379-47f7-9dfb-b905ec151ca0 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.179628 Jun 27 09:28:50.023663 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 8/14] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jun 27 09:28:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 09:28:50.036787 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-8b150527-c6cd-4f9d-84f2-8ad545d8ccce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:28:50.150520 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-8b150527-c6cd-4f9d-84f2-8ad545d8ccce admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117452 Jun 27 09:28:50.151123 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 7/15] 10.222.0.64 () {64 vars in 1335 bytes} [Mon Jun 27 09:28:50 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:28:52.265241 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-93e87e11-8379-47f7-9dfb-b905ec151ca0 admin admin] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:28:52.266254 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-93e87e11-8379-47f7-9dfb-b905ec151ca0 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jun 27 09:28:52.266651 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 9/16] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 27 09:28:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:28:52.335404 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-f793c11c-e374-46b7-a376-7aea1591978c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "d4", "name": "ds4G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "disk": 20}} {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:28:52.414647 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-f793c11c-e374-46b7-a376-7aea1591978c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141875 Jun 27 09:28:52.416251 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 8/17] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jun 27 09:28:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 09:28:52.427764 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-881905ad-79e4-4a46-9f80-0edb455b8476 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:28:52.533082 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-881905ad-79e4-4a46-9f80-0edb455b8476 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109071 Jun 27 09:28:52.534256 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 10/18] 10.222.0.64 () {64 vars in 1335 bytes} [Mon Jun 27 09:28:52 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:28:54.655260 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-f793c11c-e374-46b7-a376-7aea1591978c admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:28:54.656383 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-f793c11c-e374-46b7-a376-7aea1591978c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 Jun 27 09:28:54.656785 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 9/19] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 27 09:28:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:28:54.721064 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-c7efd2d9-6d84-462f-9d0f-b089236fe55a admin admin] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:28:54.745799 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-c7efd2d9-6d84-462f-9d0f-b089236fe55a admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082652 Jun 27 09:28:54.747646 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 11/20] 10.222.0.64 () {60 vars in 1291 bytes} [Mon Jun 27 09:28:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:28:56.871853 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-f793c11c-e374-46b7-a376-7aea1591978c admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:28:56.872984 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-f793c11c-e374-46b7-a376-7aea1591978c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001712 Jun 27 09:28:56.873422 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 10/21] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 27 09:28:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:28:56.952640 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-bf507cc5-2db6-40b7-9008-136373e213e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0, "id": "1"}} {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:28:57.049813 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-bf507cc5-2db6-40b7-9008-136373e213e6 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.170367 Jun 27 09:28:57.050418 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 12/22] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jun 27 09:28:56 2022] POST /compute/v2.1/flavors => generated 402 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 09:28:57.068307 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-2e4e9fce-6bca-474b-922e-c725fdcdbab4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:28:57.159672 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-2e4e9fce-6bca-474b-922e-c725fdcdbab4 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100389 Jun 27 09:28:57.160344 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 11/23] 10.222.0.64 () {64 vars in 1332 bytes} [Mon Jun 27 09:28:57 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:28:59.407344 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-bf507cc5-2db6-40b7-9008-136373e213e6 admin admin] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:28:59.409254 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-bf507cc5-2db6-40b7-9008-136373e213e6 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002233 Jun 27 09:28:59.409803 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 13/24] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 27 09:28:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:28:59.474173 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-1674b9b8-f97b-4265-974f-762a8af031fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2", "disk": 20, "ram": 2048}} {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:28:59.564697 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-1674b9b8-f97b-4265-974f-762a8af031fc admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.146535 Jun 27 09:28:59.565307 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 12/25] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jun 27 09:28:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 09:28:59.580851 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-753f1bfd-ac3b-4d4a-8744-359df04d5ce4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:28:59.678138 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-753f1bfd-ac3b-4d4a-8744-359df04d5ce4 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101765 Jun 27 09:28:59.678842 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 14/26] 10.222.0.64 () {64 vars in 1332 bytes} [Mon Jun 27 09:28:59 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:29:01.883292 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-1674b9b8-f97b-4265-974f-762a8af031fc admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:01.884913 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-1674b9b8-f97b-4265-974f-762a8af031fc admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002061 Jun 27 09:29:01.885326 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 13/27] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 27 09:29:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:29:01.952163 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-2f82a911-9196-45c2-8acf-0e59c75eaf64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "rxtx_factor": 1.0, "vcpus": 2, "id": "3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096}} {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:29:02.058798 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-2f82a911-9196-45c2-8acf-0e59c75eaf64 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.167705 Jun 27 09:29:02.059347 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 15/28] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jun 27 09:29:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 09:29:02.071566 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-ec72e094-9d4d-426d-af08-f9d7962ca7f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:29:02.161328 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-ec72e094-9d4d-426d-af08-f9d7962ca7f7 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093508 Jun 27 09:29:02.161948 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 14/29] 10.222.0.64 () {64 vars in 1332 bytes} [Mon Jun 27 09:29:02 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:29:04.298325 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-2f82a911-9196-45c2-8acf-0e59c75eaf64 admin admin] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:04.299379 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-2f82a911-9196-45c2-8acf-0e59c75eaf64 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Jun 27 09:29:04.300137 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 16/30] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 27 09:29:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:29:04.362709 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-9b604e7b-c3aa-4dd6-b52c-ac9750ab8e16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4", "disk": 80, "swap": 0, "ram": 8192, "vcpus": 4, "name": "m1.large", "rxtx_factor": 1.0}} {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:29:04.449605 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-9b604e7b-c3aa-4dd6-b52c-ac9750ab8e16 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.142832 Jun 27 09:29:04.450284 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 15/31] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jun 27 09:29:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 09:29:04.463090 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-82874dbe-c4ac-48a1-8b04-5cf50320121b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:29:04.545196 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-82874dbe-c4ac-48a1-8b04-5cf50320121b admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085810 Jun 27 09:29:04.546285 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 17/32] 10.222.0.64 () {64 vars in 1332 bytes} [Mon Jun 27 09:29:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:29:06.725675 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-9b604e7b-c3aa-4dd6-b52c-ac9750ab8e16 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:06.726703 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-9b604e7b-c3aa-4dd6-b52c-ac9750ab8e16 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 27 09:29:06.727169 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 16/33] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 27 09:29:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:29:06.794117 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-1c8d48ab-c41f-498f-b10f-d37a4eab94c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0, "id": "5", "disk": 160, "vcpus": 8}} {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:29:06.909966 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-1c8d48ab-c41f-498f-b10f-d37a4eab94c2 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.176453 Jun 27 09:29:06.912326 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 18/34] 10.222.0.64 () {64 vars in 1282 bytes} [Mon Jun 27 09:29:06 2022] POST /compute/v2.1/flavors => generated 408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 09:29:06.925792 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-631a371d-020c-4654-b7d5-6e67e6515c41 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:29:07.028133 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-631a371d-020c-4654-b7d5-6e67e6515c41 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106025 Jun 27 09:29:07.029014 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 17/35] 10.222.0.64 () {64 vars in 1332 bytes} [Mon Jun 27 09:29:06 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:29:32.627684 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-1c8d48ab-c41f-498f-b10f-d37a4eab94c2 admin admin] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:32.633271 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-1c8d48ab-c41f-498f-b10f-d37a4eab94c2 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jun 27 09:29:32.633271 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 19/36] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 27 09:29:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:29:32.640189 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG dbcounter [-] [103895] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:29:32.688725 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-74dc212f-3317-413a-a691-c06d45b5edc3 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:32.706689 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-74dc212f-3317-413a-a691-c06d45b5edc3 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071056 Jun 27 09:29:32.707248 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 18/37] 10.222.0.64 () {60 vars in 1291 bytes} [Mon Jun 27 09:29:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:29:33.635960 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-1c8d48ab-c41f-498f-b10f-d37a4eab94c2 admin admin] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:33.637006 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-1c8d48ab-c41f-498f-b10f-d37a4eab94c2 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 27 09:29:33.637412 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 20/38] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jun 27 09:29:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:29:33.828551 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-a4c1cd96-9cc7-4a98-b512-22022ab40bd5 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:33.833997 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.wsgi [None req-a4c1cd96-9cc7-4a98-b512-22022ab40bd5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 27 09:29:33.837350 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-a4c1cd96-9cc7-4a98-b512-22022ab40bd5 admin admin] Request method failure captured: Jun 27 09:29:33.837350 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 27 09:29:33.837350 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: Accept: application/json Jun 27 09:29:33.837350 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: Accept-Encoding: gzip, deflate Jun 27 09:29:33.837350 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: Connection: keep-alive Jun 27 09:29:33.837350 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: Content-Length: 0 Jun 27 09:29:33.837350 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: Host: 10.222.0.64 Jun 27 09:29:33.837350 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: Openstack-Api-Version: compute 2.90 Jun 27 09:29:33.837350 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: Openstack-System-Scope: None Jun 27 09:29:33.837350 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: User-Agent: python-novaclient Jun 27 09:29:33.837350 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Auth-Token: gAAAAABiuXh9iKNW63a9VVDmr6b8dELtLfS3-XH_YN3sLftxcqkMDCSDrybN7fsGySsX5UYxvDDh97yhi2Vz7CLsHoaJhTnpaturzXFQSgYRX7G64yVHtIZZOCNY323aCXpSBfROm7KCarDvdNrDnm_m2bNVYqsCEVwFB0ShNNw9ixFtFuH06gc Jun 27 09:29:33.837350 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Domain-Id: None Jun 27 09:29:33.837350 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Domain-Name: None Jun 27 09:29:33.837350 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Identity-Status: Confirmed Jun 27 09:29:33.837350 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Is-Admin-Project: True Jun 27 09:29:33.837350 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 09:29:33.837350 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Project-Domain-Id: default Jun 27 09:29:33.837350 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Project-Domain-Name: Default Jun 27 09:29:33.837350 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Project-Id: d706bacf3a904a118b091c4d80341fee Jun 27 09:29:33.837350 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Project-Name: admin Jun 27 09:29:33.837350 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Role: reader,member,admin Jun 27 09:29:33.837350 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Roles: reader,member,admin Jun 27 09:29:33.839081 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d706bacf3a904a118b091c4d80341fee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d706bacf3a904a118b091c4d80341fee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d706bacf3a904a118b091c4d80341fee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d706bacf3a904a118b091c4d80341fee", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:29:33.839081 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Tenant: admin Jun 27 09:29:33.839081 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Tenant-Id: d706bacf3a904a118b091c4d80341fee Jun 27 09:29:33.839081 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Tenant-Name: admin Jun 27 09:29:33.839081 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-User: admin Jun 27 09:29:33.839081 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-User-Domain-Id: default Jun 27 09:29:33.839081 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-User-Domain-Name: Default Jun 27 09:29:33.839081 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-User-Id: e1fa6647d77b40cd8875b5b59ec1508d Jun 27 09:29:33.839081 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-User-Name: admin Jun 27 09:29:33.839081 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: method: > Jun 27 09:29:33.839081 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: exception: Flavor 42 could not be found. Jun 27 09:29:33.839081 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: action_args: {'id': '42'} Jun 27 09:29:33.839081 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:29:33.839081 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:29:33.840215 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 09:29:33.840215 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 09:29:33.840215 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 09:29:33.840215 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 09:29:33.840215 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 09:29:33.840215 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 09:29:33.840215 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 09:29:33.840215 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 09:29:33.840215 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 09:29:33.840215 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:29:33.840215 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 09:29:33.840215 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 09:29:33.840215 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 27 09:29:33.840215 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 27 09:29:33.840215 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:29:33.840215 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 27 09:29:33.840215 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:29:33.840215 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:29:33.840215 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:29:33.841873 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:29:33.841873 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:29:33.841873 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:29:33.841873 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:29:33.841873 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 09:29:33.841873 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:29:33.841873 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 27 09:29:33.841873 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 27 09:29:33.841873 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:29:33.841873 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 27 09:29:33.841873 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:29:33.841873 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:29:33.841873 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:29:33.841873 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:29:33.841873 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:29:33.841873 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 27 09:29:33.841873 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 27 09:29:33.841873 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-a4c1cd96-9cc7-4a98-b512-22022ab40bd5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:29:33.843333 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-a4c1cd96-9cc7-4a98-b512-22022ab40bd5 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063815 Jun 27 09:29:33.843333 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 19/39] 10.222.0.64 () {60 vars in 1190 bytes} [Mon Jun 27 09:29:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 09:29:33.848727 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-a6986723-f0ea-4d3e-aacf-e41257ec59a2 admin admin] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:33.852240 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG dbcounter [-] [103896] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:29:33.871575 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-a6986723-f0ea-4d3e-aacf-e41257ec59a2 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026541 Jun 27 09:29:33.872142 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 21/40] 10.222.0.64 () {60 vars in 1210 bytes} [Mon Jun 27 09:29:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:29:33.882406 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-2ac66210-cdbb-4b0d-9a07-fc8c33b5c80f admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:33.905022 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-2ac66210-cdbb-4b0d-9a07-fc8c33b5c80f admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026561 Jun 27 09:29:33.905571 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 20/41] 10.222.0.64 () {60 vars in 1210 bytes} [Mon Jun 27 09:29:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:29:33.915918 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-5c58cbd8-dac9-4975-9d05-47f86905e91b admin admin] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:33.922010 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.wsgi [None req-5c58cbd8-dac9-4975-9d05-47f86905e91b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 27 09:29:33.925360 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-5c58cbd8-dac9-4975-9d05-47f86905e91b admin admin] Request method failure captured: Jun 27 09:29:33.925360 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 27 09:29:33.925360 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: Accept: application/json Jun 27 09:29:33.925360 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: Accept-Encoding: gzip, deflate Jun 27 09:29:33.925360 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: Connection: keep-alive Jun 27 09:29:33.925360 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: Content-Length: 0 Jun 27 09:29:33.925360 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: Host: 10.222.0.64 Jun 27 09:29:33.925360 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: Openstack-Api-Version: compute 2.90 Jun 27 09:29:33.925360 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: Openstack-System-Scope: None Jun 27 09:29:33.925360 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: User-Agent: python-novaclient Jun 27 09:29:33.925360 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Auth-Token: gAAAAABiuXh9iKNW63a9VVDmr6b8dELtLfS3-XH_YN3sLftxcqkMDCSDrybN7fsGySsX5UYxvDDh97yhi2Vz7CLsHoaJhTnpaturzXFQSgYRX7G64yVHtIZZOCNY323aCXpSBfROm7KCarDvdNrDnm_m2bNVYqsCEVwFB0ShNNw9ixFtFuH06gc Jun 27 09:29:33.925360 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Domain-Id: None Jun 27 09:29:33.925360 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Domain-Name: None Jun 27 09:29:33.925360 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Identity-Status: Confirmed Jun 27 09:29:33.925360 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Is-Admin-Project: True Jun 27 09:29:33.925360 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 09:29:33.925360 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Project-Domain-Id: default Jun 27 09:29:33.925360 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Project-Domain-Name: Default Jun 27 09:29:33.925360 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Project-Id: d706bacf3a904a118b091c4d80341fee Jun 27 09:29:33.925360 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Project-Name: admin Jun 27 09:29:33.925360 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Role: reader,member,admin Jun 27 09:29:33.925360 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Roles: reader,member,admin Jun 27 09:29:33.942186 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d706bacf3a904a118b091c4d80341fee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d706bacf3a904a118b091c4d80341fee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d706bacf3a904a118b091c4d80341fee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d706bacf3a904a118b091c4d80341fee", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:29:33.942186 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Tenant: admin Jun 27 09:29:33.942186 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Tenant-Id: d706bacf3a904a118b091c4d80341fee Jun 27 09:29:33.942186 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Tenant-Name: admin Jun 27 09:29:33.942186 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-User: admin Jun 27 09:29:33.942186 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-User-Domain-Id: default Jun 27 09:29:33.942186 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-User-Domain-Name: Default Jun 27 09:29:33.942186 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-User-Id: e1fa6647d77b40cd8875b5b59ec1508d Jun 27 09:29:33.942186 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-User-Name: admin Jun 27 09:29:33.942186 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: method: > Jun 27 09:29:33.942186 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: exception: Flavor 42 could not be found. Jun 27 09:29:33.942186 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: action_args: {'id': '42'} Jun 27 09:29:33.942186 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:29:33.942186 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:29:33.943200 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 09:29:33.943200 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 09:29:33.943200 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 09:29:33.943200 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 09:29:33.943200 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 09:29:33.943200 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 09:29:33.943200 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 09:29:33.943200 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 09:29:33.943200 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 09:29:33.943200 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:29:33.943200 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 09:29:33.943200 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 09:29:33.943200 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 27 09:29:33.943200 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi Jun 27 09:29:33.943200 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:29:33.943200 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi Jun 27 09:29:33.943200 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:29:33.943200 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:29:33.943200 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:29:33.944596 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:29:33.944596 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:29:33.944596 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:29:33.944596 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:29:33.944596 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 09:29:33.944596 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:29:33.944596 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 27 09:29:33.944596 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi Jun 27 09:29:33.944596 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:29:33.944596 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi Jun 27 09:29:33.944596 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:29:33.944596 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:29:33.944596 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:29:33.944596 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:29:33.944596 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:29:33.944596 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 27 09:29:33.944596 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi Jun 27 09:29:33.944596 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-5c58cbd8-dac9-4975-9d05-47f86905e91b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:29:33.946621 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-5c58cbd8-dac9-4975-9d05-47f86905e91b admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015151 Jun 27 09:29:33.946621 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 22/42] 10.222.0.64 () {60 vars in 1190 bytes} [Mon Jun 27 09:29:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 09:29:34.752936 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-2ac66210-cdbb-4b0d-9a07-fc8c33b5c80f admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:34.753935 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-2ac66210-cdbb-4b0d-9a07-fc8c33b5c80f admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jun 27 09:29:34.754320 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 21/43] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jun 27 09:29:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:29:34.945691 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-c657dd22-0007-4b9f-bc1c-d295d5997364 admin admin] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:34.951433 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.wsgi [None req-c657dd22-0007-4b9f-bc1c-d295d5997364 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 27 09:29:34.953041 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-c657dd22-0007-4b9f-bc1c-d295d5997364 admin admin] Request method failure captured: Jun 27 09:29:34.953041 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 27 09:29:34.953041 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: Accept: application/json Jun 27 09:29:34.953041 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: Accept-Encoding: gzip, deflate Jun 27 09:29:34.953041 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: Connection: keep-alive Jun 27 09:29:34.953041 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: Content-Length: 0 Jun 27 09:29:34.953041 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: Host: 10.222.0.64 Jun 27 09:29:34.953041 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: Openstack-Api-Version: compute 2.90 Jun 27 09:29:34.953041 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: Openstack-System-Scope: None Jun 27 09:29:34.953041 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: User-Agent: python-novaclient Jun 27 09:29:34.953041 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Auth-Token: gAAAAABiuXh-ebOSygImS2OiBn8I6EH_AzwF6iJ9eLGQJAyitMX3nWNU0Tg0F_GfPLq95A2UMAvmyq_5OZjiUhqCx54JUsrFbnQYvwjvz7oPoCWVbg1HedwJXFql_4aYtJA7aTfXix6WHGCUjC1FUtGq091hzBMyeCBuKQdIS2JA2RGuvOC4xmc Jun 27 09:29:34.953041 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Domain-Id: None Jun 27 09:29:34.953041 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Domain-Name: None Jun 27 09:29:34.953041 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Identity-Status: Confirmed Jun 27 09:29:34.953041 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Is-Admin-Project: True Jun 27 09:29:34.953041 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 09:29:34.953041 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Project-Domain-Id: default Jun 27 09:29:34.953041 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Project-Domain-Name: Default Jun 27 09:29:34.953041 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Project-Id: d706bacf3a904a118b091c4d80341fee Jun 27 09:29:34.953041 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Project-Name: admin Jun 27 09:29:34.953041 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Role: reader,member,admin Jun 27 09:29:34.953041 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Roles: reader,member,admin Jun 27 09:29:34.954579 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d706bacf3a904a118b091c4d80341fee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d706bacf3a904a118b091c4d80341fee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d706bacf3a904a118b091c4d80341fee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d706bacf3a904a118b091c4d80341fee", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:29:34.954579 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Tenant: admin Jun 27 09:29:34.954579 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Tenant-Id: d706bacf3a904a118b091c4d80341fee Jun 27 09:29:34.954579 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Tenant-Name: admin Jun 27 09:29:34.954579 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-User: admin Jun 27 09:29:34.954579 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-User-Domain-Id: default Jun 27 09:29:34.954579 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-User-Domain-Name: Default Jun 27 09:29:34.954579 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-User-Id: e1fa6647d77b40cd8875b5b59ec1508d Jun 27 09:29:34.954579 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-User-Name: admin Jun 27 09:29:34.954579 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: method: > Jun 27 09:29:34.954579 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: exception: Flavor 84 could not be found. Jun 27 09:29:34.954579 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: action_args: {'id': '84'} Jun 27 09:29:34.954579 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:29:34.954579 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:29:34.955560 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 09:29:34.955560 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 09:29:34.955560 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 09:29:34.955560 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 09:29:34.955560 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 09:29:34.955560 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 09:29:34.955560 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 09:29:34.955560 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 09:29:34.955560 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 09:29:34.955560 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:29:34.955560 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 09:29:34.955560 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 09:29:34.955560 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 27 09:29:34.955560 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi Jun 27 09:29:34.955560 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:29:34.955560 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi Jun 27 09:29:34.955560 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:29:34.955560 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:29:34.955560 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:29:34.959557 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:29:34.959557 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:29:34.959557 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:29:34.959557 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:29:34.959557 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 09:29:34.959557 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:29:34.959557 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 27 09:29:34.959557 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi Jun 27 09:29:34.959557 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:29:34.959557 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi Jun 27 09:29:34.959557 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:29:34.959557 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:29:34.959557 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:29:34.959557 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:29:34.959557 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:29:34.959557 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 27 09:29:34.959557 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi Jun 27 09:29:34.959557 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-c657dd22-0007-4b9f-bc1c-d295d5997364 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:29:34.961314 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-c657dd22-0007-4b9f-bc1c-d295d5997364 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063255 Jun 27 09:29:34.961314 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 23/44] 10.222.0.64 () {60 vars in 1190 bytes} [Mon Jun 27 09:29:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 09:29:34.965674 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-9550518f-5ca7-4812-8b2e-a3d394ad4b72 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:34.979769 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-9550518f-5ca7-4812-8b2e-a3d394ad4b72 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018062 Jun 27 09:29:34.980419 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 22/45] 10.222.0.64 () {60 vars in 1210 bytes} [Mon Jun 27 09:29:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:29:34.990356 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-0fed65f7-23b2-43da-b807-bba74714ba3e admin admin] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:35.004006 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-0fed65f7-23b2-43da-b807-bba74714ba3e admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017524 Jun 27 09:29:35.004547 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 24/46] 10.222.0.64 () {60 vars in 1210 bytes} [Mon Jun 27 09:29:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:29:35.014562 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-090825af-afcc-4b14-8e5d-be33d4d147c2 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:35.019978 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.wsgi [None req-090825af-afcc-4b14-8e5d-be33d4d147c2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 27 09:29:35.021474 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-090825af-afcc-4b14-8e5d-be33d4d147c2 admin admin] Request method failure captured: Jun 27 09:29:35.021474 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 27 09:29:35.021474 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: Accept: application/json Jun 27 09:29:35.021474 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: Accept-Encoding: gzip, deflate Jun 27 09:29:35.021474 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: Connection: keep-alive Jun 27 09:29:35.021474 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: Content-Length: 0 Jun 27 09:29:35.021474 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: Host: 10.222.0.64 Jun 27 09:29:35.021474 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: Openstack-Api-Version: compute 2.90 Jun 27 09:29:35.021474 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: Openstack-System-Scope: None Jun 27 09:29:35.021474 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: User-Agent: python-novaclient Jun 27 09:29:35.021474 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Auth-Token: gAAAAABiuXh-ebOSygImS2OiBn8I6EH_AzwF6iJ9eLGQJAyitMX3nWNU0Tg0F_GfPLq95A2UMAvmyq_5OZjiUhqCx54JUsrFbnQYvwjvz7oPoCWVbg1HedwJXFql_4aYtJA7aTfXix6WHGCUjC1FUtGq091hzBMyeCBuKQdIS2JA2RGuvOC4xmc Jun 27 09:29:35.021474 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Domain-Id: None Jun 27 09:29:35.021474 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Domain-Name: None Jun 27 09:29:35.021474 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Identity-Status: Confirmed Jun 27 09:29:35.021474 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Is-Admin-Project: True Jun 27 09:29:35.021474 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 09:29:35.021474 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Project-Domain-Id: default Jun 27 09:29:35.021474 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Project-Domain-Name: Default Jun 27 09:29:35.021474 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Project-Id: d706bacf3a904a118b091c4d80341fee Jun 27 09:29:35.021474 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Project-Name: admin Jun 27 09:29:35.021474 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Role: reader,member,admin Jun 27 09:29:35.021474 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Roles: reader,member,admin Jun 27 09:29:35.023468 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d706bacf3a904a118b091c4d80341fee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d706bacf3a904a118b091c4d80341fee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d706bacf3a904a118b091c4d80341fee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d706bacf3a904a118b091c4d80341fee", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:29:35.023468 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Tenant: admin Jun 27 09:29:35.023468 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Tenant-Id: d706bacf3a904a118b091c4d80341fee Jun 27 09:29:35.023468 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Tenant-Name: admin Jun 27 09:29:35.023468 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-User: admin Jun 27 09:29:35.023468 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-User-Domain-Id: default Jun 27 09:29:35.023468 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-User-Domain-Name: Default Jun 27 09:29:35.023468 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-User-Id: e1fa6647d77b40cd8875b5b59ec1508d Jun 27 09:29:35.023468 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-User-Name: admin Jun 27 09:29:35.023468 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: method: > Jun 27 09:29:35.023468 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: exception: Flavor 84 could not be found. Jun 27 09:29:35.023468 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: action_args: {'id': '84'} Jun 27 09:29:35.023468 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:29:35.023468 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:29:35.024594 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 09:29:35.024594 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 09:29:35.024594 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 09:29:35.024594 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 09:29:35.024594 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 09:29:35.024594 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 09:29:35.024594 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 09:29:35.024594 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 09:29:35.024594 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 09:29:35.024594 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:29:35.024594 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 09:29:35.024594 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 09:29:35.024594 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 27 09:29:35.024594 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 27 09:29:35.024594 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:29:35.024594 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 27 09:29:35.024594 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:29:35.024594 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:29:35.024594 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:29:35.026032 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:29:35.026032 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:29:35.026032 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:29:35.026032 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:29:35.026032 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 09:29:35.026032 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:29:35.026032 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 27 09:29:35.026032 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 27 09:29:35.026032 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:29:35.026032 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 27 09:29:35.026032 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:29:35.026032 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:29:35.026032 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:29:35.026032 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:29:35.026032 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:29:35.026032 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 27 09:29:35.026032 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 27 09:29:35.026032 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-090825af-afcc-4b14-8e5d-be33d4d147c2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:29:35.027320 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-090825af-afcc-4b14-8e5d-be33d4d147c2 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011944 Jun 27 09:29:35.027320 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 23/47] 10.222.0.64 () {60 vars in 1190 bytes} [Mon Jun 27 09:29:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 09:29:35.840254 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-0fed65f7-23b2-43da-b807-bba74714ba3e admin admin] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:35.841257 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-0fed65f7-23b2-43da-b807-bba74714ba3e admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Jun 27 09:29:35.841650 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 25/48] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jun 27 09:29:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:29:36.033206 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-3cd26d9e-acf6-4728-b939-570a4aeace0f admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:36.039674 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.wsgi [None req-3cd26d9e-acf6-4728-b939-570a4aeace0f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 27 09:29:36.041159 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-3cd26d9e-acf6-4728-b939-570a4aeace0f admin admin] Request method failure captured: Jun 27 09:29:36.041159 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 27 09:29:36.041159 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: Accept: application/json Jun 27 09:29:36.041159 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: Accept-Encoding: gzip, deflate Jun 27 09:29:36.041159 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: Connection: keep-alive Jun 27 09:29:36.041159 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: Content-Length: 0 Jun 27 09:29:36.041159 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: Host: 10.222.0.64 Jun 27 09:29:36.041159 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: Openstack-Api-Version: compute 2.90 Jun 27 09:29:36.041159 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: Openstack-System-Scope: None Jun 27 09:29:36.041159 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: User-Agent: python-novaclient Jun 27 09:29:36.041159 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Auth-Token: gAAAAABiuXh_sgXBQeyOd2sTKtG64fxSdEXS51BhU2DPcq-imGIitLjOYhzryUrCafpypLFFv7upfkxuGfji8R-LnIBcCBIafArJ6MY1F_bhVyahkbXhgtP-1pnpQBPCCZEuj1z9zHR086wRmipr4HkBGvFzcdzVm6qo7119zRHpe_i-bEYCaxE Jun 27 09:29:36.041159 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Domain-Id: None Jun 27 09:29:36.041159 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Domain-Name: None Jun 27 09:29:36.041159 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Identity-Status: Confirmed Jun 27 09:29:36.041159 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Is-Admin-Project: True Jun 27 09:29:36.041159 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 09:29:36.041159 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Project-Domain-Id: default Jun 27 09:29:36.041159 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Project-Domain-Name: Default Jun 27 09:29:36.041159 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Project-Id: d706bacf3a904a118b091c4d80341fee Jun 27 09:29:36.041159 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Project-Name: admin Jun 27 09:29:36.041159 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Role: reader,member,admin Jun 27 09:29:36.041159 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Roles: reader,member,admin Jun 27 09:29:36.042710 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d706bacf3a904a118b091c4d80341fee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d706bacf3a904a118b091c4d80341fee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d706bacf3a904a118b091c4d80341fee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d706bacf3a904a118b091c4d80341fee", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:29:36.042710 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Tenant: admin Jun 27 09:29:36.042710 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Tenant-Id: d706bacf3a904a118b091c4d80341fee Jun 27 09:29:36.042710 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-Tenant-Name: admin Jun 27 09:29:36.042710 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-User: admin Jun 27 09:29:36.042710 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-User-Domain-Id: default Jun 27 09:29:36.042710 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-User-Domain-Name: Default Jun 27 09:29:36.042710 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-User-Id: e1fa6647d77b40cd8875b5b59ec1508d Jun 27 09:29:36.042710 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: X-User-Name: admin Jun 27 09:29:36.042710 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: method: > Jun 27 09:29:36.042710 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: exception: Flavor 451 could not be found. Jun 27 09:29:36.042710 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: action_args: {'id': '451'} Jun 27 09:29:36.042710 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:29:36.042710 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:29:36.043584 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 09:29:36.043584 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 09:29:36.043584 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 09:29:36.043584 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 09:29:36.043584 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 09:29:36.043584 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 09:29:36.043584 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 09:29:36.043584 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 09:29:36.043584 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 09:29:36.043584 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:29:36.043584 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 09:29:36.043584 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 09:29:36.043584 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 27 09:29:36.043584 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 27 09:29:36.043584 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:29:36.043584 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 27 09:29:36.043584 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:29:36.043584 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:29:36.043584 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:29:36.044891 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:29:36.044891 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:29:36.044891 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:29:36.044891 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:29:36.044891 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 09:29:36.044891 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:29:36.044891 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 27 09:29:36.044891 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 27 09:29:36.044891 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:29:36.044891 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 27 09:29:36.044891 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:29:36.044891 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:29:36.044891 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:29:36.044891 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:29:36.044891 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:29:36.044891 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 27 09:29:36.044891 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 27 09:29:36.044891 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-3cd26d9e-acf6-4728-b939-570a4aeace0f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:29:36.046226 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-3cd26d9e-acf6-4728-b939-570a4aeace0f admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061526 Jun 27 09:29:36.046226 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 24/49] 10.222.0.64 () {60 vars in 1193 bytes} [Mon Jun 27 09:29:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 09:29:36.052143 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-8afe6eab-6e12-420e-ab57-7d71ff47ed07 admin admin] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:36.070071 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-8afe6eab-6e12-420e-ab57-7d71ff47ed07 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021485 Jun 27 09:29:36.070630 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 26/50] 10.222.0.64 () {60 vars in 1210 bytes} [Mon Jun 27 09:29:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:29:36.080171 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-004ae839-4537-4d8a-9e40-d4acd942eb4c admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:36.093552 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-004ae839-4537-4d8a-9e40-d4acd942eb4c admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016887 Jun 27 09:29:36.094073 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 25/51] 10.222.0.64 () {60 vars in 1210 bytes} [Mon Jun 27 09:29:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:29:36.103519 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-f9ab72d6-d724-479e-a201-b576c9c26660 admin admin] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:36.108827 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.wsgi [None req-f9ab72d6-d724-479e-a201-b576c9c26660 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 27 09:29:36.110320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-f9ab72d6-d724-479e-a201-b576c9c26660 admin admin] Request method failure captured: Jun 27 09:29:36.110320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 27 09:29:36.110320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: Accept: application/json Jun 27 09:29:36.110320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: Accept-Encoding: gzip, deflate Jun 27 09:29:36.110320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: Connection: keep-alive Jun 27 09:29:36.110320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: Content-Length: 0 Jun 27 09:29:36.110320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: Host: 10.222.0.64 Jun 27 09:29:36.110320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: Openstack-Api-Version: compute 2.90 Jun 27 09:29:36.110320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: Openstack-System-Scope: None Jun 27 09:29:36.110320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: User-Agent: python-novaclient Jun 27 09:29:36.110320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Auth-Token: gAAAAABiuXh_sgXBQeyOd2sTKtG64fxSdEXS51BhU2DPcq-imGIitLjOYhzryUrCafpypLFFv7upfkxuGfji8R-LnIBcCBIafArJ6MY1F_bhVyahkbXhgtP-1pnpQBPCCZEuj1z9zHR086wRmipr4HkBGvFzcdzVm6qo7119zRHpe_i-bEYCaxE Jun 27 09:29:36.110320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Domain-Id: None Jun 27 09:29:36.110320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Domain-Name: None Jun 27 09:29:36.110320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Identity-Status: Confirmed Jun 27 09:29:36.110320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Is-Admin-Project: True Jun 27 09:29:36.110320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 09:29:36.110320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Project-Domain-Id: default Jun 27 09:29:36.110320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Project-Domain-Name: Default Jun 27 09:29:36.110320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Project-Id: d706bacf3a904a118b091c4d80341fee Jun 27 09:29:36.110320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Project-Name: admin Jun 27 09:29:36.110320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Role: reader,member,admin Jun 27 09:29:36.110320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Roles: reader,member,admin Jun 27 09:29:36.111708 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d706bacf3a904a118b091c4d80341fee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d706bacf3a904a118b091c4d80341fee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d706bacf3a904a118b091c4d80341fee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d706bacf3a904a118b091c4d80341fee", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:29:36.111708 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Tenant: admin Jun 27 09:29:36.111708 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Tenant-Id: d706bacf3a904a118b091c4d80341fee Jun 27 09:29:36.111708 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-Tenant-Name: admin Jun 27 09:29:36.111708 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-User: admin Jun 27 09:29:36.111708 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-User-Domain-Id: default Jun 27 09:29:36.111708 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-User-Domain-Name: Default Jun 27 09:29:36.111708 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-User-Id: e1fa6647d77b40cd8875b5b59ec1508d Jun 27 09:29:36.111708 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: X-User-Name: admin Jun 27 09:29:36.111708 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: method: > Jun 27 09:29:36.111708 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: exception: Flavor 451 could not be found. Jun 27 09:29:36.111708 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: action_args: {'id': '451'} Jun 27 09:29:36.111708 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:29:36.111708 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:29:36.112569 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 09:29:36.112569 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 09:29:36.112569 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 09:29:36.112569 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 09:29:36.112569 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 09:29:36.112569 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 09:29:36.112569 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 09:29:36.112569 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 09:29:36.112569 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 09:29:36.112569 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:29:36.112569 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 09:29:36.112569 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 09:29:36.112569 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 27 09:29:36.112569 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi Jun 27 09:29:36.112569 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:29:36.112569 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi Jun 27 09:29:36.112569 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:29:36.112569 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:29:36.112569 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:29:36.113952 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:29:36.113952 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:29:36.113952 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:29:36.113952 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:29:36.113952 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 09:29:36.113952 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:29:36.113952 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 27 09:29:36.113952 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi Jun 27 09:29:36.113952 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:29:36.113952 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi Jun 27 09:29:36.113952 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:29:36.113952 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:29:36.113952 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:29:36.113952 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:29:36.113952 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:29:36.113952 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 27 09:29:36.113952 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: ERROR nova.api.openstack.wsgi Jun 27 09:29:36.113952 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-f9ab72d6-d724-479e-a201-b576c9c26660 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:29:36.115192 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-f9ab72d6-d724-479e-a201-b576c9c26660 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012218 Jun 27 09:29:36.115192 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 27/52] 10.222.0.64 () {60 vars in 1193 bytes} [Mon Jun 27 09:29:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 09:29:36.936118 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-004ae839-4537-4d8a-9e40-d4acd942eb4c admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:36.937161 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-004ae839-4537-4d8a-9e40-d4acd942eb4c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Jun 27 09:29:36.937562 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 26/53] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jun 27 09:29:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:29:37.128004 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-9c80aefc-54f3-425b-bfb7-514197ccfe69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:29:37.253609 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-9c80aefc-54f3-425b-bfb7-514197ccfe69 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.177818 Jun 27 09:29:37.254985 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 28/54] 10.222.0.64 () {64 vars in 1235 bytes} [Mon Jun 27 09:29:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 09:29:38.080928 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-004ae839-4537-4d8a-9e40-d4acd942eb4c admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:38.081943 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-004ae839-4537-4d8a-9e40-d4acd942eb4c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jun 27 09:29:38.082341 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jun 27 09:29:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:29:38.279003 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-2bca6f25-fa27-4b42-95d7-82f99772a283 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:29:38.425843 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-2bca6f25-fa27-4b42-95d7-82f99772a283 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.201458 Jun 27 09:29:38.426320 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 29/56] 10.222.0.64 () {64 vars in 1235 bytes} [Mon Jun 27 09:29:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 09:29:39.260417 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-004ae839-4537-4d8a-9e40-d4acd942eb4c admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:39.261429 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-004ae839-4537-4d8a-9e40-d4acd942eb4c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jun 27 09:29:39.261832 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 28/57] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jun 27 09:29:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:29:39.451602 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-02456a2b-929c-4e89-8276-7f5f593fd2f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:29:39.521923 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-02456a2b-929c-4e89-8276-7f5f593fd2f7 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.121201 Jun 27 09:29:39.522478 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 30/58] 10.222.0.64 () {64 vars in 1235 bytes} [Mon Jun 27 09:29:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 09:29:40.350684 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-004ae839-4537-4d8a-9e40-d4acd942eb4c admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:40.352297 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-004ae839-4537-4d8a-9e40-d4acd942eb4c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002024 Jun 27 09:29:40.352697 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 29/59] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jun 27 09:29:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:29:40.547949 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-4d90958f-4b99-46aa-b707-baa6ab063e9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:29:40.629800 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-4d90958f-4b99-46aa-b707-baa6ab063e9a admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.134613 Jun 27 09:29:40.630349 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 31/60] 10.222.0.64 () {64 vars in 1235 bytes} [Mon Jun 27 09:29:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 09:29:41.449212 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-004ae839-4537-4d8a-9e40-d4acd942eb4c admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:41.450332 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-004ae839-4537-4d8a-9e40-d4acd942eb4c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Jun 27 09:29:41.450728 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 30/61] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jun 27 09:29:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:29:41.652610 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-f85d1f32-5180-414e-9a8b-de47a2543f9f admin admin] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:29:41.671781 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-f85d1f32-5180-414e-9a8b-de47a2543f9f admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070322 Jun 27 09:29:41.672315 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 32/62] 10.222.0.64 () {60 vars in 1202 bytes} [Mon Jun 27 09:29:41 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:30:28.775105 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-004ae839-4537-4d8a-9e40-d4acd942eb4c admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:30:28.776143 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-004ae839-4537-4d8a-9e40-d4acd942eb4c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 27 09:30:28.776543 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 31/63] 10.222.0.64 () {54 vars in 930 bytes} [Mon Jun 27 09:30:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:30:28.787371 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG dbcounter [-] [103896] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:30:28.837924 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-815bbe2a-547f-40d5-b6f9-b1c9cdf4cbcc admin admin] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:30:28.857344 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-815bbe2a-547f-40d5-b6f9-b1c9cdf4cbcc admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074826 Jun 27 09:30:28.857885 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 33/64] 10.222.0.64 () {60 vars in 1291 bytes} [Mon Jun 27 09:30:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:30:28.881774 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-19fb5dbc-8ee5-4b42-b4c7-235c4b0114be admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:30:28.885357 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG dbcounter [-] [103895] Writing DB stats nova_api:SELECT=14 {{(pid=103895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:30:28.890362 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-19fb5dbc-8ee5-4b42-b4c7-235c4b0114be admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012773 Jun 27 09:30:28.890933 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 32/65] 10.222.0.64 () {60 vars in 1282 bytes} [Mon Jun 27 09:30:28 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:30:28.902518 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-58629adc-4e06-4976-932e-ea1ec359c656 admin admin] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:30:28.910473 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-58629adc-4e06-4976-932e-ea1ec359c656 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011643 Jun 27 09:30:28.910998 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 34/66] 10.222.0.64 () {60 vars in 1285 bytes} [Mon Jun 27 09:30:28 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:30:28.922920 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-9ba4f6a8-8a53-4591-83b2-5bf8f3c9d85b admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:30:28.931204 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-9ba4f6a8-8a53-4591-83b2-5bf8f3c9d85b admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012172 Jun 27 09:30:28.931791 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 33/67] 10.222.0.64 () {60 vars in 1285 bytes} [Mon Jun 27 09:30:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:30:28.944117 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-905dfd2d-6bd7-49ce-89ef-10712f1d08bf admin admin] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:30:28.951719 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-905dfd2d-6bd7-49ce-89ef-10712f1d08bf admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012037 Jun 27 09:30:28.952235 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 35/68] 10.222.0.64 () {60 vars in 1282 bytes} [Mon Jun 27 09:30:28 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:33:57.540876 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-9ba4f6a8-8a53-4591-83b2-5bf8f3c9d85b admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:33:57.541976 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-9ba4f6a8-8a53-4591-83b2-5bf8f3c9d85b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Jun 27 09:33:57.542377 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 34/69] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jun 27 09:33:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:33:57.683795 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG dbcounter [-] [103896] Writing DB stats nova_api:SELECT=6 {{(pid=103896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:33:57.798715 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-50e53196-dc16-42a0-ab20-6311ec7fa0ad admin admin] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:33:57.799948 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 09:33:57.799948 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: warnings.warn(msg) Jun 27 09:33:57.801148 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG oslo_concurrency.lockutils [None req-50e53196-dc16-42a0-ab20-6311ec7fa0ad admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:33:57.801591 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG oslo_concurrency.lockutils [None req-50e53196-dc16-42a0-ab20-6311ec7fa0ad admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:33:57.802439 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG oslo_concurrency.lockutils [None req-50e53196-dc16-42a0-ab20-6311ec7fa0ad admin admin] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:33:57.803323 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG oslo_concurrency.lockutils [None req-50e53196-dc16-42a0-ab20-6311ec7fa0ad admin admin] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:33:57.836885 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-50e53196-dc16-42a0-ab20-6311ec7fa0ad admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.154458 Jun 27 09:33:57.837451 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 36/70] 10.222.0.64 () {60 vars in 1193 bytes} [Mon Jun 27 09:33:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 09:33:58.674837 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-9ba4f6a8-8a53-4591-83b2-5bf8f3c9d85b admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:33:58.675915 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-9ba4f6a8-8a53-4591-83b2-5bf8f3c9d85b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jun 27 09:33:58.676311 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 35/71] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jun 27 09:33:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:33:58.880198 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-a333f865-7f9e-4f4c-96fd-030fce92d8de admin admin] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:33:58.882051 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 09:33:58.882051 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: warnings.warn(msg) Jun 27 09:33:58.883489 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG oslo_concurrency.lockutils [None req-a333f865-7f9e-4f4c-96fd-030fce92d8de admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:33:58.884003 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG oslo_concurrency.lockutils [None req-a333f865-7f9e-4f4c-96fd-030fce92d8de admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:33:58.884805 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG oslo_concurrency.lockutils [None req-a333f865-7f9e-4f4c-96fd-030fce92d8de admin admin] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:33:58.885396 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG oslo_concurrency.lockutils [None req-a333f865-7f9e-4f4c-96fd-030fce92d8de admin admin] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:33:58.905491 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-a333f865-7f9e-4f4c-96fd-030fce92d8de admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.087337 Jun 27 09:33:58.906054 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 37/72] 10.222.0.64 () {60 vars in 1193 bytes} [Mon Jun 27 09:33:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 09:34:10.135716 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-9ba4f6a8-8a53-4591-83b2-5bf8f3c9d85b admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:34:10.136734 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-9ba4f6a8-8a53-4591-83b2-5bf8f3c9d85b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 27 09:34:10.137183 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 36/73] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jun 27 09:34:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:34:10.281529 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG dbcounter [-] [103896] Writing DB stats nova_cell0:SELECT=4 {{(pid=103896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:10.282282 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG dbcounter [-] [103896] Writing DB stats nova_cell1:SELECT=4 {{(pid=103896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:10.282903 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG dbcounter [-] [103896] Writing DB stats nova_api:SELECT=8 {{(pid=103896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:34:10.332230 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-6cfb418c-a029-46c0-8dea-409a67cb6c03 admin admin] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:34:10.334013 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 09:34:10.334013 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: warnings.warn(msg) Jun 27 09:34:10.335201 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG oslo_concurrency.lockutils [None req-6cfb418c-a029-46c0-8dea-409a67cb6c03 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:34:10.335663 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG oslo_concurrency.lockutils [None req-6cfb418c-a029-46c0-8dea-409a67cb6c03 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:34:10.336467 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG oslo_concurrency.lockutils [None req-6cfb418c-a029-46c0-8dea-409a67cb6c03 admin admin] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:34:10.336936 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG oslo_concurrency.lockutils [None req-6cfb418c-a029-46c0-8dea-409a67cb6c03 admin admin] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:34:10.362491 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-6cfb418c-a029-46c0-8dea-409a67cb6c03 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085359 Jun 27 09:34:10.363046 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 38/74] 10.222.0.64 () {60 vars in 1193 bytes} [Mon Jun 27 09:34:10 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:34:11.195022 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-9ba4f6a8-8a53-4591-83b2-5bf8f3c9d85b admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:34:11.196076 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-9ba4f6a8-8a53-4591-83b2-5bf8f3c9d85b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jun 27 09:34:11.196509 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 37/75] 10.222.0.64 () {56 vars in 1074 bytes} [Mon Jun 27 09:34:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:34:11.388609 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG nova.api.openstack.wsgi [None req-fb9624a6-444d-478f-bb60-f98ef9a8beb9 admin admin] Calling method '>' {{(pid=103896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:34:11.389806 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 09:34:11.389806 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: warnings.warn(msg) Jun 27 09:34:11.391002 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG oslo_concurrency.lockutils [None req-fb9624a6-444d-478f-bb60-f98ef9a8beb9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:34:11.391472 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG oslo_concurrency.lockutils [None req-fb9624a6-444d-478f-bb60-f98ef9a8beb9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:34:11.392286 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG oslo_concurrency.lockutils [None req-fb9624a6-444d-478f-bb60-f98ef9a8beb9 admin admin] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:34:11.392717 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: DEBUG oslo_concurrency.lockutils [None req-fb9624a6-444d-478f-bb60-f98ef9a8beb9 admin admin] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:34:11.414662 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: INFO nova.api.openstack.requestlog [None req-fb9624a6-444d-478f-bb60-f98ef9a8beb9 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078408 Jun 27 09:34:11.415149 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: [pid: 103896|app: 0|req: 39/76] 10.222.0.64 () {60 vars in 1193 bytes} [Mon Jun 27 09:34:11 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:35:11.886051 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: Mon Jun 27 09:35:11 2022 - graceful shutdown triggered... Jun 27 09:35:11.886190 dv-cinder-847730-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 27 09:35:11.886988 dv-cinder-847730-1-iscsi devstack@n-api.service[103896]: Gracefully killing worker 2 (pid: 103896)... Jun 27 09:35:11.887357 dv-cinder-847730-1-iscsi devstack@n-api.service[103895]: Gracefully killing worker 1 (pid: 103895)... Jun 27 09:35:12.887731 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: worker 1 buried after 1 seconds Jun 27 09:35:12.887731 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: worker 2 buried after 1 seconds Jun 27 09:35:12.887731 dv-cinder-847730-1-iscsi devstack@n-api.service[103894]: goodbye to uWSGI. Jun 27 09:35:12.889315 dv-cinder-847730-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 27 09:35:12.889872 dv-cinder-847730-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 27 09:35:12.892735 dv-cinder-847730-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 27 09:35:12.903661 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 27 09:35:12.905649 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 27 09:35:12 2022] *** Jun 27 09:35:12.905649 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 27 09:35:12.905649 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 27 09:35:12.905649 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: nodename: dv-cinder-847730-1-iscsi Jun 27 09:35:12.905649 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: machine: x86_64 Jun 27 09:35:12.905649 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: clock source: unix Jun 27 09:35:12.905649 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: pcre jit disabled Jun 27 09:35:12.905649 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: detected number of CPU cores: 4 Jun 27 09:35:12.905649 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: current working directory: / Jun 27 09:35:12.905649 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: detected binary path: /usr/bin/uwsgi-core Jun 27 09:35:12.905649 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: your processes number limit is 47680 Jun 27 09:35:12.905649 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: your memory page size is 4096 bytes Jun 27 09:35:12.905649 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: detected max file descriptor number: 2048 Jun 27 09:35:12.906639 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: lock engine: pthread robust mutexes Jun 27 09:35:12.906639 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: thunder lock: enabled Jun 27 09:35:12.906639 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 27 09:35:12.906639 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 27 09:35:12.951638 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: Python main interpreter initialized at 0x55ccb30e69c0 Jun 27 09:35:12.951638 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: python threads support enabled Jun 27 09:35:12.951638 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: your server socket listen backlog is limited to 100 connections Jun 27 09:35:12.951638 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: your mercy for graceful operations on workers is 90 seconds Jun 27 09:35:12.952105 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: mapped 403077 bytes (393 KB) for 2 cores Jun 27 09:35:12.952105 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: *** Operational MODE: preforking *** Jun 27 09:35:12.952418 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: *** uWSGI is running in multiple interpreter mode *** Jun 27 09:35:12.952418 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: spawned uWSGI master process (pid: 124854) Jun 27 09:35:12.952571 dv-cinder-847730-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 27 09:35:12.953129 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: spawned uWSGI worker 1 (pid: 124869, cores: 1) Jun 27 09:35:12.953621 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: spawned uWSGI worker 2 (pid: 124870, cores: 1) Jun 27 09:35:12.953896 dv-cinder-847730-1-iscsi devstack@n-api.service[124854]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 27 09:35:13.627263 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 09:35:13.627881 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 09:35:14.839729 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 09:35:14.839729 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: from cryptography.utils import int_from_bytes Jun 27 09:35:14.840530 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 09:35:14.840530 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: from cryptography.utils import int_from_bytes Jun 27 09:35:14.841345 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 09:35:14.841345 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: from cryptography.utils import int_from_bytes Jun 27 09:35:14.841892 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 09:35:14.841892 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: from cryptography.utils import int_from_bytes Jun 27 09:35:17.259882 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 09:35:17.260500 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 09:35:17.260800 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 09:35:17.261083 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 09:35:17.261345 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 09:35:17.261773 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.262106 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.262435 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.262763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.263104 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.263423 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.263785 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.264117 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.264460 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.264728 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.265057 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.265396 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847730-1-iscsi {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.265722 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.266037 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.266356 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.266683 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.266995 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.267326 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.267674 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.271602 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.271602 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.271602 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.271602 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.271973 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.272502 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.273058 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.273667 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.274211 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.275182 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.275569 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.275995 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847730-1-iscsi {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.276864 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.276864 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.277025 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.277114 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 09:35:17.277455 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 09:35:17.277527 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.277778 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.277878 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 09:35:17.278105 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.278222 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 09:35:17.278436 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.278542 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 09:35:17.278771 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.278878 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.279123 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.279231 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.279463 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.279697 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.279848 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.279938 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.280156 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.280261 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.280479 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.280584 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.280810 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.280919 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.281145 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.281252 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.281479 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.281577 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.281748 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.281859 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.282077 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.282240 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.282389 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847730-1-iscsi {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.282553 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.282714 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.282872 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.283023 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.283165 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.283312 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.283454 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.283646 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.283806 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.283959 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.284105 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.284257 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.284418 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.284560 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.284715 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.284864 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.285068 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.285229 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.285398 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.285550 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.285705 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.285856 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.286015 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.286220 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.286374 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.286533 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.286686 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.286839 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.286981 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.287133 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.287291 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.287433 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.293598 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.293598 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.293938 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.294133 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.294297 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.294450 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.294592 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.294745 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.294894 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847730-1-iscsi {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.295046 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.295199 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.295353 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.295506 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.295717 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.295867 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.296126 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.296331 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.296489 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.296639 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.296791 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.296943 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.297096 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.297239 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.297435 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.297610 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.297752 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.297910 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.298060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.298202 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.298361 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.298512 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.298663 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.298816 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.298965 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.299107 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.299258 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.299411 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.299579 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.299740 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.299896 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.300045 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.300197 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.300339 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.300493 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.300647 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.300789 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.300938 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.301090 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.301238 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.301393 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.301393 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.301393 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.301393 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.301393 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.301393 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.301393 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.301393 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.302530 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.302530 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.302530 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.302530 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.302530 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.302530 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.303335 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.303484 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.303673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.303845 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.304010 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.304159 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.304310 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.304472 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.304620 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.304620 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.304938 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.304938 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.305230 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.305381 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.305530 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.305687 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.305839 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.305987 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.306137 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.306285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.306437 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.306589 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.306738 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.306964 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.307108 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.307250 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.307391 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.307600 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.307759 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.307921 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.308072 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.308224 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.308372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.308514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.308665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.308816 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.308959 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.309099 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.309248 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.309388 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.309530 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.309693 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.309835 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.309977 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.310118 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.310273 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.310425 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.310573 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.310722 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.310871 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.311023 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.311188 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.311188 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.311188 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.311777 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.311927 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.312078 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.312220 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.312374 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.312516 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.312656 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.312804 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.312948 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.313089 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.313243 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.313393 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.313558 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.313711 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.313853 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.314007 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.314161 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.314302 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.314444 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.314583 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.314730 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.314879 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.315031 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.315179 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.315322 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.315488 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.315773 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.315943 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.316088 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.316240 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.316383 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.316540 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.316769 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.316947 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.317093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.317241 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.317391 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.317545 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.317700 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.317842 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.317983 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.317983 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.318262 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.318405 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.318559 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.318708 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.318849 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.318997 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.319138 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.319278 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.319442 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.319653 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.319653 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.319943 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.320093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.320241 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.320392 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.320535 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.320675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.320824 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.320824 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.320824 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.321730 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.321882 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.322036 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.322188 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.322344 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.322485 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.322626 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.322773 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.322928 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.323078 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.323228 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.323375 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.323543 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.323706 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.323872 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.324014 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.324163 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.324312 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.324464 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.324605 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.324763 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.324916 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.325058 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.325205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.325353 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.325495 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.325650 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.325802 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.325943 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.326091 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.326232 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.326390 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.326541 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.326696 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.326839 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.326979 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.327130 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.327286 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.327428 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.327616 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.327771 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.327922 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.328072 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.328072 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.328349 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.328499 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.328648 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.328797 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.328948 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.329098 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.329250 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.329469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.329673 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.329828 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.329978 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.330126 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 09:35:17.330277 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.330277 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.330555 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.330696 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.330844 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.330986 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.330986 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.331271 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.331420 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.331620 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.331782 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.331945 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.332096 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.332251 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.332409 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.332409 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.332409 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.332912 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.333064 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.333219 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.333374 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.333538 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.333690 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.333846 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.333998 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.334158 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.334306 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.334453 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.334608 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.334756 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.334903 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.335059 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.335208 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.335355 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.335521 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.335705 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.335905 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.336064 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.336213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.336360 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.336519 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.336675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.336936 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.337628 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.337779 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.337934 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.338091 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.338269 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.338269 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.338559 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.338717 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.338875 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.339023 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.339178 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.339327 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.339473 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.339694 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.339855 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.339855 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.339855 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.340309 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.340508 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.341258 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.341422 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.341572 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.341734 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.341884 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.342031 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.342178 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.342326 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.342528 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.342704 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.342861 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.343017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.343173 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.343321 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.343477 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.343668 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.343828 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.343984 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.343984 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.344304 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.344465 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.344634 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.344783 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.344930 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.345076 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.345222 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.345383 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.345540 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.345698 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.345846 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.346000 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.346155 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.346316 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.346465 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.346630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.346786 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.346934 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.347082 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.347082 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.347373 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.347520 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.347760 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.347907 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.348065 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.348228 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.348228 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.348517 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.348729 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.348890 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.349049 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.349205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.349360 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.349516 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.349516 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.349805 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.349805 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.350100 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.350100 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.350100 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.350531 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.350689 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.350846 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.351002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.351157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.351313 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.351469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.351639 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.351805 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.351955 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.352109 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.352265 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.352451 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.352614 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.352786 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.352936 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.353083 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.353239 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.353394 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.353556 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.353723 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.353872 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.354028 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.354177 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.354332 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.354717 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.354885 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.355035 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.355183 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.355330 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.355485 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.355684 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.356010 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.356164 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.356313 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.356469 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.356621 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.356719 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.356800 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.356871 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.356999 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.357091 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.357183 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.357276 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.357359 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.357441 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.357530 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.357530 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.357705 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.357795 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.357877 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.357964 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.358054 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.358144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.358246 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.358377 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.358475 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.358618 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.358713 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.358798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.359074 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.359183 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.359439 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.359570 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.359750 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.359854 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.360068 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.360159 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.360384 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.360474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.360697 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.360797 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.361019 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.361160 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.361331 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.361446 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.361647 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.361819 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.361965 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.362079 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.362279 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.362378 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.362605 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.362707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.362915 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.363063 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.363211 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.363343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.363573 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.363670 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.363875 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.363974 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.364203 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.364293 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.364534 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.364671 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.364869 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.364975 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.365182 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.365281 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.365515 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.365608 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.365834 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.365933 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.366148 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.366244 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.366474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.366564 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.366798 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.366920 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.367119 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.367281 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.367441 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.367631 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.367805 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.367948 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.368155 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.368304 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.368489 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.368636 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.368960 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.369116 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.369284 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.369463 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.369602 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.369789 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.369919 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.370121 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.370252 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.370440 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.370580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.370768 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.370898 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.371121 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.371221 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.371469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.371661 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.371827 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.371956 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.372161 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.372295 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.372483 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.372609 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.372811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.372929 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.373131 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.373256 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.373451 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.373574 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.373772 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.373898 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.374093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.374222 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.374417 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.374532 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.374737 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.375016 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.375142 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.375360 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.375486 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.375713 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.375840 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.376041 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.376189 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.376372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.376524 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.376687 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.376989 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.377106 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.377339 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.377480 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.377677 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.377777 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.377993 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.378083 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.378316 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.378417 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.378643 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.378741 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.378959 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.379154 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.379314 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.379451 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.380494 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.380677 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.380805 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.380918 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.381029 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.381129 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.381220 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.381314 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.381404 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.381483 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.381554 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.381629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.381711 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.381807 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.381891 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.382017 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.382139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.382343 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.382443 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.382661 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.382752 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.382976 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.383067 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.383290 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.383395 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.384151 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.384264 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.384483 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.384598 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.384807 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.384913 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.385117 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.385216 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.385433 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.385534 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.385760 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.385859 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.386074 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.386175 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.386404 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.386499 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.386727 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.386822 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.387042 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.387278 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.387391 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.387823 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.387948 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.388036 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.388121 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.388267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.388368 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.388592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.388762 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.388899 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.389032 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.389435 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.389543 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.389762 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.389856 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.390089 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.390188 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.390409 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.390509 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.390731 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.390830 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.391051 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.391143 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.391380 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.391477 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.391725 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.391827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.392041 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.392140 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.392360 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.392452 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.392675 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.392777 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.392993 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.393082 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.393311 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.393417 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.393627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.393726 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.393938 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.394029 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.394256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.394473 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.394573 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.394671 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.394908 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.395033 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.395199 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.395347 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.395512 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.395826 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.396019 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.396174 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.396336 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.396509 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.396636 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.396844 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.396938 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.397181 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.397354 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.397503 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.397651 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.397846 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.398032 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.398170 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.398315 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.398532 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.398698 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.398851 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.399003 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.399171 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.399986 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.400151 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.400297 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.400444 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.400593 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.400740 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.400893 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.401033 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.401184 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.401400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.401562 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.401696 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.401834 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.401980 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.402118 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.402265 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.402408 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.402548 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.402686 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.402823 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.402984 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.403146 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.403295 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.403442 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.403604 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.403750 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.403890 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.404037 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.404176 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.404313 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.404449 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.404592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.404736 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.404907 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.405069 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.405240 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.405342 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.405560 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.405666 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.405874 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.405967 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.406185 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.406284 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.406497 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.406602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.406855 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.406955 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.407171 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.407263 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.407607 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.407710 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.407903 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.408042 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.408231 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.408339 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.408583 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.408674 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.408898 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.408989 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.409213 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.409312 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.409537 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.409636 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.409848 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.409949 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.410200 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.410334 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.410519 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.410620 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.410841 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.410941 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.411154 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.411255 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.411505 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.411697 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.411817 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.411909 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.412143 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.412246 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.412461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.412553 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.413039 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.413135 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.413370 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.413476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.413692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.413790 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.414003 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.414094 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.414314 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.414418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.414632 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.414723 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.414972 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.415073 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.415286 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.415391 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.415624 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.415738 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.415937 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.416031 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.416263 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.416365 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.416580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.416679 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.416894 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.416995 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.417204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.417305 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.417518 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.417609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.417833 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.417923 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.418151 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.418288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.418462 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.418568 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.418794 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.418912 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.419106 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.419213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.419415 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.419505 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.419755 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.419869 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.420093 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.420191 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.420413 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.420521 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.420724 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.420826 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.421095 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.421193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.421422 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.421522 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.421785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.421886 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.422103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.422209 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.422417 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.422515 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.422731 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.422832 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.423045 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.423148 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.423363 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.423462 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.423697 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.423792 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.424011 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.424125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.424324 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.424445 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.424635 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.424764 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.424947 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.425082 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.425280 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.425379 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.425599 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.425691 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.425913 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.426004 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.426227 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.426318 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.426546 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.426645 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.426900 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.426999 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.427209 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.427314 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.427569 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.427702 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.427873 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.427977 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.428213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.428322 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.428539 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.428648 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.428860 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.428952 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.429181 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.429281 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.429509 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.429696 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.429848 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.429965 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.430175 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.430382 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.430496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.430610 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.430842 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.430941 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.431158 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.431358 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.431453 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.431595 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.431825 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.431928 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.432149 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.432241 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.432470 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.432561 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.432801 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.432892 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.433136 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.433236 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.433472 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.433581 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.433780 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.433871 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.434096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.434188 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.434417 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.434516 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.434736 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.434843 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.435057 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.435157 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.435380 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.435495 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.435723 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.435942 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.436041 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.436125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.436356 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.436448 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.436683 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.436789 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.437006 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.437139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.437323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.437414 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.437642 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.437753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.437961 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.438062 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.438273 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.438411 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.438600 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.438691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.438922 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.439039 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.439243 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.439380 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.439591 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.439724 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.439973 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.440084 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.440180 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.440457 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.440569 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.440763 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.440866 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.441107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.441200 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.441440 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.441561 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.441761 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.441845 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.442099 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.442192 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.442437 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.442587 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.442729 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.442859 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.443068 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.443218 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.443396 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.443578 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.443737 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.443822 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.444049 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.444169 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.444364 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.444492 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.444729 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.444897 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.445041 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.445170 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.445400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.445555 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.445701 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.445831 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.446672 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.446855 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.447010 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.447151 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.447289 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.447436 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.447612 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.447722 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.447810 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.447893 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.448155 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.448353 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.448534 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.449010 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.449156 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.449296 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.449296 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.449599 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.449825 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.449998 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.450514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.450659 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.450743 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.450842 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.450930 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.451014 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.451097 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.451180 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.451263 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.451356 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.451443 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.451554 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.451639 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.451880 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.451995 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.452189 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.452286 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.452515 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.452616 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.452842 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.452964 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.453154 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.453258 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.453465 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.453575 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.453776 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.453964 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.454110 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.454203 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.454427 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.454520 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.454761 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.454866 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.455087 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.455189 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.455410 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.455502 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.455769 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.455875 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.456085 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.456187 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.456415 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.456509 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.456740 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.456835 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.457065 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.457158 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.457418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.457530 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.457740 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.457843 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.458065 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.458165 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.458381 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.458476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.458695 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.458789 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.459009 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.459122 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.459331 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.459435 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.459675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.459808 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.459979 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.460075 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.460376 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.460561 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.460660 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.460896 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.461000 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.461216 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.461315 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.461548 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.461646 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.462422 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.462533 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.462760 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.462853 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.463084 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.463179 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.463405 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.463508 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.463751 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.463857 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.464073 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.464167 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.464393 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.464486 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.464717 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.464818 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.465033 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.465134 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.465346 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.465439 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.465661 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.465765 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.466021 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.466115 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.466339 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.466431 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.466662 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.466764 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.466984 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.467077 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.467340 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.467443 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.467685 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.467793 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.468015 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.468109 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.468338 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.468472 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.468665 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.468759 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.468989 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.469104 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.469314 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.469430 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.469627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.469817 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.469942 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.470083 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.470261 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.470437 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.470640 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.470742 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.470882 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.470983 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.471198 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.471305 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.471516 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.471630 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.471873 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.471966 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.472219 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.472316 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.472532 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.472634 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.472860 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.472975 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.473200 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.473294 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.473525 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.473618 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.473847 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.474059 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.474161 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.474385 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.474495 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.474730 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.474824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.475066 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.475175 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.475402 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.475496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.475753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.475855 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.476083 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.476176 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.476420 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.476510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.476734 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.476834 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.477049 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.477153 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.477404 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.477508 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.477730 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.477832 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.478045 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.478139 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.478370 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.478461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.478691 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.478786 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.479015 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.479111 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.479428 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.479596 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.479688 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.479786 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.480005 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.480215 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.480316 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.480579 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.480732 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.480907 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.481011 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.481242 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.481517 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.481609 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.481861 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.481968 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.482191 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.482283 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.482517 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.482610 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.482840 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.482946 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.483156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.483249 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.483478 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.483601 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.483828 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.483922 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.484144 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.484238 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.484457 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.484550 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.484778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.484871 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.485094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.485186 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.485407 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.485510 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.485725 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.485819 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.486038 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.486139 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.486372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.486474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.486688 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.486781 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.487000 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.487100 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.487315 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.487420 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.487664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.487774 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.487981 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.488074 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.488296 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.488402 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.488610 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.488760 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.488921 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.489015 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.489241 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.489335 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.489563 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.489701 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.489882 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.490001 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.490217 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.490318 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.490530 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.490646 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.490826 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.490955 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.491146 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.491432 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.491596 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.491816 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.491967 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.492154 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.492298 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.492468 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.492617 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.492788 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.492940 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.493156 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.493313 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.493465 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.493613 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.493796 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.493945 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.494119 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.494327 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.494478 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.494651 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.494788 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.494993 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.495145 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.495330 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.495648 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.495801 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.495994 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.496146 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.496322 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.496466 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.496661 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.496800 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.496977 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.497128 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.497298 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.497435 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.497613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.497770 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.497912 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.498063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.498231 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.498380 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.498554 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.498703 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.498856 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.499014 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.499178 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.499319 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.499495 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.499645 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.499839 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.499954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.500177 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.503568 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.503698 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.503798 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.503898 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.503986 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.504069 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.504160 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.504252 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.504252 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.504415 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.504510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.504595 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.504685 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.504770 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.504861 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.504959 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.505044 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.505135 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.505135 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.505298 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.505394 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.505479 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.505561 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.505644 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.505734 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.505818 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.505914 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.505999 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.506089 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.506181 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.506265 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.506354 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.506447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.506531 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.506613 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.506702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.506792 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.506885 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.506971 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.507060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.507145 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.507227 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.507308 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.507410 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.507495 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.507611 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.507705 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.507852 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.508003 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.508186 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.508283 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.508499 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.508593 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.509770 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.509976 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.510088 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.510175 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.510259 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.510348 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.510441 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.510559 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.510654 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.511045 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.511195 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.511287 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.511413 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.511516 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.511681 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.511774 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.511893 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.511995 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.512227 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.512331 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.512544 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.512645 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.512860 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.512969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.513183 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.513285 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.513500 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.513592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.513816 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.513907 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.514129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.514223 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.514443 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.514537 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.514761 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.514855 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.515073 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.515176 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.515385 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.515689 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.515791 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.516019 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.516126 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.516334 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.516427 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.516644 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.516806 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.516956 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.517052 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.517266 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.517358 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.517576 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.517677 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.517887 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.517981 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.518195 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.518296 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.518511 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.518604 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.518822 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.518924 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.519133 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.519233 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.519442 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.519577 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.519864 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.519966 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.520077 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.520170 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.520415 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.520524 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.520734 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.520828 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.521155 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.521301 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.521401 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.521490 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.521677 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.521780 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.521996 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.522090 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.522310 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.522412 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.522631 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.522723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.522958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.523052 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.523284 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.523386 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.523621 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.524086 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.524086 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.524372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.525018 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.525110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.525285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.525386 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.525607 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.525919 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.526027 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.526239 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.526515 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.526616 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.526888 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.527117 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.527229 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.527539 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.527768 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.527873 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.528195 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.528372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.528524 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.528849 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.528999 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.529170 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.529510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.529653 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.529831 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.530150 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.530470 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.530565 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.530788 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.531159 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.531277 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.531515 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.531642 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.531901 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.532039 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.532290 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.532393 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.532630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.532724 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.532972 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.533080 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.533422 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.533517 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.533783 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.533884 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.534144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.534250 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.534473 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.534573 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.534830 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.534931 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.535228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.535330 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.535603 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.535729 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.535950 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.536056 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.536275 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.536386 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.536668 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 09:35:17.536785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.536980 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.537236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.537569 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.538158 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.538473 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.538796 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.539113 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.539433 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.539777 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.540124 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.540445 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.540762 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.541080 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.541404 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.541703 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.542017 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.542331 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.542649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.542963 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.543276 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.543613 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.543933 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.544248 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.544591 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.544936 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.545263 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.545596 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.545919 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.546254 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.546574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.546907 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.547239 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.547588 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.547910 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.548254 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.548579 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.548902 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.549225 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.549551 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.549869 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.550194 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.550532 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.550872 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.551191 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.551549 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.551890 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.552220 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.552582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.552872 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.553214 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.553537 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.553925 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.554260 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.554583 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.554907 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.555236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.555610 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.555952 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.556291 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.556610 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.556951 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.557283 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.557650 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.557974 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.558372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.558661 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.558982 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.559303 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.559778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 09:35:17.559907 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 09:35:17.599297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO dbcounter [None req-d0e4a3e5-2442-40be-8c72-fd82703a73a8 None None] Registered counter for database nova_api Jun 27 09:35:17.620172 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_db.sqlalchemy.engines [None req-d0e4a3e5-2442-40be-8c72-fd82703a73a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 09:35:17.623203 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO dbcounter [None req-a40a0802-ba8e-461f-8046-ce035a618450 None None] Registered counter for database nova_api Jun 27 09:35:17.627146 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writer thread running {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 09:35:17.643551 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_db.sqlalchemy.engines [None req-a40a0802-ba8e-461f-8046-ce035a618450 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 09:35:17.650156 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writer thread running {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 09:35:17.685827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.context [None req-d0e4a3e5-2442-40be-8c72-fd82703a73a8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),75b3599f-e531-4aef-9894-8ae95c783344(cell1) {{(pid=124869) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 09:35:17.690023 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d0e4a3e5-2442-40be-8c72-fd82703a73a8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:35:17.691636 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d0e4a3e5-2442-40be-8c72-fd82703a73a8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:35:17.692455 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d0e4a3e5-2442-40be-8c72-fd82703a73a8 None None] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:35:17.694405 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d0e4a3e5-2442-40be-8c72-fd82703a73a8 None None] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:35:17.697072 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO dbcounter [None req-d0e4a3e5-2442-40be-8c72-fd82703a73a8 None None] Registered counter for database nova_cell0 Jun 27 09:35:17.701496 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO dbcounter [None req-d0e4a3e5-2442-40be-8c72-fd82703a73a8 None None] Registered counter for database nova_cell1 Jun 27 09:35:17.708503 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.context [None req-a40a0802-ba8e-461f-8046-ce035a618450 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),75b3599f-e531-4aef-9894-8ae95c783344(cell1) {{(pid=124870) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 09:35:17.709045 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_db.sqlalchemy.engines [None req-d0e4a3e5-2442-40be-8c72-fd82703a73a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 09:35:17.711551 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_db.sqlalchemy.engines [None req-d0e4a3e5-2442-40be-8c72-fd82703a73a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 09:35:17.712803 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a40a0802-ba8e-461f-8046-ce035a618450 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:35:17.714422 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a40a0802-ba8e-461f-8046-ce035a618450 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:35:17.715241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a40a0802-ba8e-461f-8046-ce035a618450 None None] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:35:17.717099 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writer thread running {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 09:35:17.717239 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a40a0802-ba8e-461f-8046-ce035a618450 None None] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:35:17.719167 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writer thread running {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 09:35:17.719277 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO dbcounter [None req-a40a0802-ba8e-461f-8046-ce035a618450 None None] Registered counter for database nova_cell0 Jun 27 09:35:17.723311 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO dbcounter [None req-a40a0802-ba8e-461f-8046-ce035a618450 None None] Registered counter for database nova_cell1 Jun 27 09:35:17.730600 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_db.sqlalchemy.engines [None req-a40a0802-ba8e-461f-8046-ce035a618450 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 09:35:17.732906 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_db.sqlalchemy.engines [None req-a40a0802-ba8e-461f-8046-ce035a618450 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 09:35:17.740696 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writer thread running {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 09:35:17.741042 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writer thread running {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 09:35:17.874697 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO dbcounter [None req-d0e4a3e5-2442-40be-8c72-fd82703a73a8 None None] Registered counter for database nova_cell0 Jun 27 09:35:17.881508 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_db.sqlalchemy.engines [None req-d0e4a3e5-2442-40be-8c72-fd82703a73a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 09:35:17.887105 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writer thread running {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 09:35:17.894418 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO dbcounter [None req-a40a0802-ba8e-461f-8046-ce035a618450 None None] Registered counter for database nova_cell0 Jun 27 09:35:17.903157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_db.sqlalchemy.engines [None req-a40a0802-ba8e-461f-8046-ce035a618450 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 09:35:17.908684 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writer thread running {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 09:35:18.209485 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: WARNING keystonemiddleware.auth_token [None req-d0e4a3e5-2442-40be-8c72-fd82703a73a8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 09:35:18.216806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: WARNING keystonemiddleware.auth_token [None req-d0e4a3e5-2442-40be-8c72-fd82703a73a8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 09:35:18.232545 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: WARNING keystonemiddleware.auth_token [None req-a40a0802-ba8e-461f-8046-ce035a618450 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 09:35:18.240001 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: WARNING keystonemiddleware.auth_token [None req-a40a0802-ba8e-461f-8046-ce035a618450 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 09:35:18.564948 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: WARNING keystonemiddleware.auth_token [None req-d0e4a3e5-2442-40be-8c72-fd82703a73a8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 09:35:18.571063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: WARNING keystonemiddleware.auth_token [None req-d0e4a3e5-2442-40be-8c72-fd82703a73a8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 09:35:18.576638 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ccb30e69c0 pid: 124869 (default app) Jun 27 09:35:18.583986 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: WARNING keystonemiddleware.auth_token [None req-a40a0802-ba8e-461f-8046-ce035a618450 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 09:35:18.590518 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: WARNING keystonemiddleware.auth_token [None req-a40a0802-ba8e-461f-8046-ce035a618450 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 09:35:18.600155 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ccb30e69c0 pid: 124870 (default app) Jun 27 09:36:00.528058 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=3 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:00.534110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=3 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:00.534110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell0:SELECT=3 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:00.534110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell0:SELECT=3 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:01.502223 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-fedb00b5-a7d2-4e9f-8d14-34f605e4c24d tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Action: 'create', calling method: .version_select at 0x7ffa9d4a9790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1104430491"}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:36:03.424407 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-fedb00b5-a7d2-4e9f-8d14-34f605e4c24d tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.805460 Jun 27 09:36:03.424407 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 1/1] 10.222.0.64 () {60 vars in 1154 bytes} [Mon Jun 27 09:36:00 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2809 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 27 09:36:03.697954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-2a80b060-a3ff-4158-9555-a07ed3f86da6 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Calling method '.version_select at 0x7ffa9d55c280>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:03.725190 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=3 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:03.726206 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=3 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:03.727957 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=3 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:03.728906 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=3 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:04.651461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-2a80b060-a3ff-4158-9555-a07ed3f86da6 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/63595e87-4b5a-4b17-88ed-01e6426e0c5d" status: 200 len: 346 microversion: 2.1 time: 1.319999 Jun 27 09:36:04.652577 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 1/2] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 27 09:36:03 2022] GET /compute/v2.1/os-volumes/63595e87-4b5a-4b17-88ed-01e6426e0c5d => generated 346 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:36:04.665673 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-5870691d-ec12-47b5-ad14-dc6cba192efd tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Action: 'create', calling method: .version_select at 0x7ffa9d371550>, body: {"snapshot": {"volume_id": "63595e87-4b5a-4b17-88ed-01e6426e0c5d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1756252253"}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:36:04.734673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-51b1531a-db0a-4a37-b122-3a0c41c111f6 tempest-VolumesTestJSON-1708364433 tempest-VolumesTestJSON-1708364433-project] Calling method '.version_select at 0x7ffa9d3b4700>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:05.423393 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-51b1531a-db0a-4a37-b122-3a0c41c111f6 tempest-VolumesTestJSON-1708364433 tempest-VolumesTestJSON-1708364433-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/dfa25e53-642b-4da8-9954-b264f84de2f8" status: 200 len: 351 microversion: 2.1 time: 0.698127 Jun 27 09:36:05.430382 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 27 09:36:04 2022] GET /compute/v2.1/os-volumes/dfa25e53-642b-4da8-9954-b264f84de2f8 => generated 351 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:36:05.507906 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-5870691d-ec12-47b5-ad14-dc6cba192efd tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] 10.222.0.64 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.847778 Jun 27 09:36:05.508518 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 2/4] 10.222.0.64 () {60 vars in 1161 bytes} [Mon Jun 27 09:36:04 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:36:05.519551 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-9b703712-e8bc-4352-972b-797747c57b41 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Calling method '.version_select at 0x7ffa9d3b4940>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:05.672669 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-9b703712-e8bc-4352-972b-797747c57b41 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/66e36234-578d-4bc6-bcf8-c755415743b0" status: 200 len: 287 microversion: 2.1 time: 0.157938 Jun 27 09:36:05.679132 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 3/5] 10.222.0.64 () {58 vars in 1250 bytes} [Mon Jun 27 09:36:05 2022] GET /compute/v2.1/os-snapshots/66e36234-578d-4bc6-bcf8-c755415743b0 => generated 287 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:36:05.684724 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-7960080f-f674-43a6-8796-4374c1a8d501 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Calling method '.version_select at 0x7ffa9d3715e0>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:05.754972 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-7960080f-f674-43a6-8796-4374c1a8d501 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.073915 Jun 27 09:36:05.756303 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 3/6] 10.222.0.64 () {58 vars in 1139 bytes} [Mon Jun 27 09:36:05 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:36:05.768188 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e086bce8-ae78-4be9-a2f6-46051a992ec0 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Calling method '.version_select at 0x7ffa9d3b4e50>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:05.975299 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e086bce8-ae78-4be9-a2f6-46051a992ec0 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/66e36234-578d-4bc6-bcf8-c755415743b0" status: 200 len: 287 microversion: 2.1 time: 0.211382 Jun 27 09:36:05.978680 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1250 bytes} [Mon Jun 27 09:36:05 2022] GET /compute/v2.1/os-snapshots/66e36234-578d-4bc6-bcf8-c755415743b0 => generated 287 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:36:07.002274 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-412a2a78-1e07-4727-94af-1c88217d94ba tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Calling method '.version_select at 0x7ffa9d30a310>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:07.095080 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-412a2a78-1e07-4727-94af-1c88217d94ba tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/66e36234-578d-4bc6-bcf8-c755415743b0" status: 200 len: 287 microversion: 2.1 time: 0.108456 Jun 27 09:36:07.096117 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1250 bytes} [Mon Jun 27 09:36:06 2022] GET /compute/v2.1/os-snapshots/66e36234-578d-4bc6-bcf8-c755415743b0 => generated 287 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:36:08.108456 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-96cccc8e-718f-4b3f-a29c-8d42cd5488b4 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Calling method '.version_select at 0x7ffa9d37b550>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:08.203887 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-96cccc8e-718f-4b3f-a29c-8d42cd5488b4 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/66e36234-578d-4bc6-bcf8-c755415743b0" status: 200 len: 287 microversion: 2.1 time: 0.099370 Jun 27 09:36:08.207820 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 5/9] 10.222.0.64 () {58 vars in 1250 bytes} [Mon Jun 27 09:36:08 2022] GET /compute/v2.1/os-snapshots/66e36234-578d-4bc6-bcf8-c755415743b0 => generated 287 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:36:09.217647 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-1142fcd7-63c5-4930-ac90-a44f1f1b01a7 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Calling method '.version_select at 0x7ffa9d30aa60>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:09.414689 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-1142fcd7-63c5-4930-ac90-a44f1f1b01a7 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/66e36234-578d-4bc6-bcf8-c755415743b0" status: 200 len: 288 microversion: 2.1 time: 0.201954 Jun 27 09:36:09.415277 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 5/10] 10.222.0.64 () {58 vars in 1250 bytes} [Mon Jun 27 09:36:09 2022] GET /compute/v2.1/os-snapshots/66e36234-578d-4bc6-bcf8-c755415743b0 => generated 288 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:36:09.425439 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-abb89f80-1d73-45f0-82d5-77603a546498 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Calling method '.version_select at 0x7ffa9d3b4b80>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:09.606882 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-abb89f80-1d73-45f0-82d5-77603a546498 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] 10.222.0.64 "DELETE /compute/v2.1/os-snapshots/66e36234-578d-4bc6-bcf8-c755415743b0" status: 202 len: 0 microversion: 2.1 time: 0.185020 Jun 27 09:36:09.607633 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 6/11] 10.222.0.64 () {58 vars in 1253 bytes} [Mon Jun 27 09:36:09 2022] DELETE /compute/v2.1/os-snapshots/66e36234-578d-4bc6-bcf8-c755415743b0 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:36:09.617748 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-05070c81-f0b8-413a-a4a5-894e5a7cda69 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Calling method '.version_select at 0x7ffa9d3714c0>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:09.689441 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-05070c81-f0b8-413a-a4a5-894e5a7cda69 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/66e36234-578d-4bc6-bcf8-c755415743b0" status: 200 len: 287 microversion: 2.1 time: 0.076304 Jun 27 09:36:09.692886 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 6/12] 10.222.0.64 () {58 vars in 1250 bytes} [Mon Jun 27 09:36:09 2022] GET /compute/v2.1/os-snapshots/66e36234-578d-4bc6-bcf8-c755415743b0 => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:36:10.248908 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-b77214cd-b9e7-4263-a27d-da73e579d24e tempest-VolumesTestJSON-1708364433 tempest-VolumesTestJSON-1708364433-project] Calling method '.version_select at 0x7ffa9d371ca0>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:10.258953 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-bce54185-4745-4251-a2c4-9acf64ee04f0 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Action: 'create', calling method: .version_select at 0x7ffa9d3b4670>, body: {"keypair": {"name": "tempest-keypair-1478563327", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObYY7gP1oSumhnUiI2Ym2XNTH3YP5NpBq+/Ka6nGUXfVItAfAy7m9jNS5vdHWpcEn3NqNwvqVZYVZLzScZJv8+vr6cQcoA08d6e0Bzd+c/KOK+YutwlPrsrni7Nz/TNvQ=="}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:36:10.350823 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-b77214cd-b9e7-4263-a27d-da73e579d24e tempest-VolumesTestJSON-1708364433 tempest-VolumesTestJSON-1708364433-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/30e383b4-609c-4335-9d05-1846c74cfff9" status: 200 len: 350 microversion: 2.1 time: 0.101663 Jun 27 09:36:10.350823 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 27 09:36:10 2022] GET /compute/v2.1/os-volumes/30e383b4-609c-4335-9d05-1846c74cfff9 => generated 350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:36:10.360859 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-bce54185-4745-4251-a2c4-9acf64ee04f0 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Getting quotas for project 79203b0660c041f49c5f2629bd5a0bdf. Resources: {'key_pairs'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:36:10.376077 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-bce54185-4745-4251-a2c4-9acf64ee04f0 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Getting quotas for user ecf085030e8e4a65a7140fea2b64a7ed and project 79203b0660c041f49c5f2629bd5a0bdf. Resources: {'key_pairs'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:36:10.587570 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-bce54185-4745-4251-a2c4-9acf64ee04f0 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.600044 Jun 27 09:36:10.594057 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 7/14] 10.222.0.64 () {62 vars in 1199 bytes} [Mon Jun 27 09:36:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 608 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 27 09:36:10.701299 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-37b32744-713a-4b28-98f1-e198db17084c tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Calling method '.version_select at 0x7ffa9d30a790>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:10.791608 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-37b32744-713a-4b28-98f1-e198db17084c tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/66e36234-578d-4bc6-bcf8-c755415743b0" status: 200 len: 287 microversion: 2.1 time: 0.093926 Jun 27 09:36:10.792537 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 8/15] 10.222.0.64 () {58 vars in 1250 bytes} [Mon Jun 27 09:36:10 2022] GET /compute/v2.1/os-snapshots/66e36234-578d-4bc6-bcf8-c755415743b0 => generated 287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:36:11.805140 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-ca6b3b6a-41f2-4e96-bdd6-94f3d09c66d1 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Calling method '.version_select at 0x7ffa9d2d89d0>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:11.880891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-ca6b3b6a-41f2-4e96-bdd6-94f3d09c66d1 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/66e36234-578d-4bc6-bcf8-c755415743b0" status: 200 len: 287 microversion: 2.1 time: 0.081881 Jun 27 09:36:11.882012 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 8/16] 10.222.0.64 () {58 vars in 1250 bytes} [Mon Jun 27 09:36:11 2022] GET /compute/v2.1/os-snapshots/66e36234-578d-4bc6-bcf8-c755415743b0 => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:36:12.895074 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-de09ac0b-e73f-40b6-8b75-2a406d564b76 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Calling method '.version_select at 0x7ffa9d3715e0>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:12.927437 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-de09ac0b-e73f-40b6-8b75-2a406d564b76 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] HTTP exception thrown: Snapshot 66e36234-578d-4bc6-bcf8-c755415743b0 could not be found. Jun 27 09:36:12.930555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-de09ac0b-e73f-40b6-8b75-2a406d564b76 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Request method failure captured: Jun 27 09:36:12.930555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: GET /compute/v2.1/os-snapshots/66e36234-578d-4bc6-bcf8-c755415743b0 HTTP/1.1 Jun 27 09:36:12.930555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:36:12.930555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:36:12.930555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:36:12.930555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:36:12.930555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:36:12.930555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:36:12.930555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:36:12.930555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:36:12.930555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXoAYS2Om9STNAtMYCPMf-I6B0LVgvJ346Yws5PAB-rXAxhnbC2WMp4G09JxipaRWjgtOlIZM8eV50C23LzmFUB1J_YkKtU6qDUwhoqi-cdqLaJUoxJ_isjrSlqr808xPJnXk_Y6JnSqQYO40A4VmnMFv71O_bEduNWGjJYqoRz1c9I Jun 27 09:36:12.930555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:36:12.930555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:36:12.930555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:36:12.930555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:36:12.930555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:36:12.930555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:36:12.930555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: eb3c0fa49ea5424399304b9f9b18e866 Jun 27 09:36:12.930555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-180013553 Jun 27 09:36:12.930555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:36:12.930555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:36:12.931679 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb3c0fa49ea5424399304b9f9b18e866"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb3c0fa49ea5424399304b9f9b18e866"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/eb3c0fa49ea5424399304b9f9b18e866"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_eb3c0fa49ea5424399304b9f9b18e866", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:36:12.931679 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-VolumesSnapshotsTestJSON-180013553 Jun 27 09:36:12.931679 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: eb3c0fa49ea5424399304b9f9b18e866 Jun 27 09:36:12.931679 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-180013553 Jun 27 09:36:12.931679 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-VolumesSnapshotsTestJSON-180013553-project Jun 27 09:36:12.931679 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:36:12.931679 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:36:12.931679 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: 0e7a041f66e245189135fe8bedc93448 Jun 27 09:36:12.931679 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-VolumesSnapshotsTestJSON-180013553-project Jun 27 09:36:12.931679 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: Jun 27 09:36:12.931679 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Snapshot 66e36234-578d-4bc6-bcf8-c755415743b0 could not be found. Jun 27 09:36:12.931679 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'id': '66e36234-578d-4bc6-bcf8-c755415743b0'} Jun 27 09:36:12.931679 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:36:12.932302 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:36:12.932302 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 27 09:36:12.932302 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 27 09:36:12.932302 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 27 09:36:12.932302 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 27 09:36:12.932302 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 27 09:36:12.932302 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 27 09:36:12.932302 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 09:36:12.932302 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 09:36:12.932302 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 09:36:12.932302 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 09:36:12.932302 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 09:36:12.932302 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 09:36:12.932302 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 09:36:12.932302 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 09:36:12.932302 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 66e36234-578d-4bc6-bcf8-c755415743b0 could not be found. (HTTP 404) (Request-ID: req-d4ae7300-6bbc-4642-ad3b-1ac7678e3463) Jun 27 09:36:12.932302 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:12.932302 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:36:12.933163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:12.933163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:36:12.933163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 27 09:36:12.933163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 27 09:36:12.933163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 09:36:12.933163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 09:36:12.933163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 27 09:36:12.933163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 27 09:36:12.933163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 09:36:12.933163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 09:36:12.933163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 27 09:36:12.933163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 27 09:36:12.933163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 27 09:36:12.933163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 27 09:36:12.933163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 27 09:36:12.933163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 27 09:36:12.933163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 09:36:12.933163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 09:36:12.933163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 09:36:12.934063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 09:36:12.934063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 09:36:12.934063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 09:36:12.934063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 09:36:12.934063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 09:36:12.934063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 66e36234-578d-4bc6-bcf8-c755415743b0 could not be found. Jun 27 09:36:12.934063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:12.934063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:36:12.934063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:12.934063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:36:12.934063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:36:12.934063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:36:12.934063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:36:12.934063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:36:12.934063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 09:36:12.934063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 09:36:12.934063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:36:12.934063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:36:12.934063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 27 09:36:12.934063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:36:12.935016 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 66e36234-578d-4bc6-bcf8-c755415743b0 could not be found. Jun 27 09:36:12.935016 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:12.935016 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:36:12.935016 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:12.935016 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:36:12.935016 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:36:12.935016 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:36:12.935016 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:36:12.935016 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:36:12.935016 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 66e36234-578d-4bc6-bcf8-c755415743b0 could not be found. Jun 27 09:36:12.935016 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:12.935016 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-de09ac0b-e73f-40b6-8b75-2a406d564b76 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Returning 404 to user: Snapshot 66e36234-578d-4bc6-bcf8-c755415743b0 could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:36:12.935016 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-de09ac0b-e73f-40b6-8b75-2a406d564b76 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/66e36234-578d-4bc6-bcf8-c755415743b0" status: 404 len: 111 microversion: 2.1 time: 0.043200 Jun 27 09:36:12.940582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-896c74ad-58a7-443b-84b0-fe23d5fd0a0c tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Calling method '.version_select at 0x7ffa9ca8e0d0>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:12.955979 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 9/17] 10.222.0.64 () {58 vars in 1250 bytes} [Mon Jun 27 09:36:12 2022] GET /compute/v2.1/os-snapshots/66e36234-578d-4bc6-bcf8-c755415743b0 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:36:13.213064 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-896c74ad-58a7-443b-84b0-fe23d5fd0a0c tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/63595e87-4b5a-4b17-88ed-01e6426e0c5d" status: 202 len: 0 microversion: 2.1 time: 0.276098 Jun 27 09:36:13.213669 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 9/18] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jun 27 09:36:12 2022] DELETE /compute/v2.1/os-volumes/63595e87-4b5a-4b17-88ed-01e6426e0c5d => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 09:36:13.229719 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-3612d51e-eaf3-4455-9337-bf7310c66b3a tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Calling method '.version_select at 0x7ffa9dcd5b80>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:13.413143 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-3612d51e-eaf3-4455-9337-bf7310c66b3a tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/63595e87-4b5a-4b17-88ed-01e6426e0c5d" status: 200 len: 345 microversion: 2.1 time: 0.193307 Jun 27 09:36:13.414452 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 10/19] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 27 09:36:13 2022] GET /compute/v2.1/os-volumes/63595e87-4b5a-4b17-88ed-01e6426e0c5d => generated 345 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:36:13.513778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-47c7826b-3030-4068-a5e2-9fddf997bcb1 tempest-VolumesTestJSON-1708364433 tempest-VolumesTestJSON-1708364433-project] Calling method '.version_select at 0x7ffa9ca8e820>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:13.596002 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-47c7826b-3030-4068-a5e2-9fddf997bcb1 tempest-VolumesTestJSON-1708364433 tempest-VolumesTestJSON-1708364433-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/b812b224-1956-4249-a2f2-e5698c89a0d4" status: 200 len: 350 microversion: 2.1 time: 0.086141 Jun 27 09:36:13.603113 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 10/20] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 27 09:36:13 2022] GET /compute/v2.1/os-volumes/b812b224-1956-4249-a2f2-e5698c89a0d4 => generated 350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:36:13.608762 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-ecca3d51-5a75-4230-a93a-dc3253e624a0 tempest-VolumesTestJSON-1708364433 tempest-VolumesTestJSON-1708364433-project] Calling method '.version_select at 0x7ffa9d371d30>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:13.750529 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-ecca3d51-5a75-4230-a93a-dc3253e624a0 tempest-VolumesTestJSON-1708364433 tempest-VolumesTestJSON-1708364433-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.145956 Jun 27 09:36:13.751276 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 11/21] 10.222.0.64 () {58 vars in 1133 bytes} [Mon Jun 27 09:36:13 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:13.765484 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-b093cef2-fef3-44bf-8dde-e19e880449a9 tempest-VolumesTestJSON-1708364433 tempest-VolumesTestJSON-1708364433-project] Calling method '.version_select at 0x7ffa9d2d8e50>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:13.962961 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-b093cef2-fef3-44bf-8dde-e19e880449a9 tempest-VolumesTestJSON-1708364433 tempest-VolumesTestJSON-1708364433-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.202585 Jun 27 09:36:13.964218 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 11/22] 10.222.0.64 () {58 vars in 1148 bytes} [Mon Jun 27 09:36:13 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:36:13.976578 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-729bc036-0cec-4d58-b019-7468d2db42ae tempest-VolumesTestJSON-1708364433 tempest-VolumesTestJSON-1708364433-project] Calling method '.version_select at 0x7ffa9d30caf0>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:14.213576 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-729bc036-0cec-4d58-b019-7468d2db42ae tempest-VolumesTestJSON-1708364433 tempest-VolumesTestJSON-1708364433-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.241178 Jun 27 09:36:14.217164 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 12/23] 10.222.0.64 () {58 vars in 1133 bytes} [Mon Jun 27 09:36:13 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:14.231600 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-201ea80c-b79f-4594-a6bc-24ba0849e646 tempest-VolumesTestJSON-1708364433 tempest-VolumesTestJSON-1708364433-project] Calling method '.version_select at 0x7ffa9ca8e9d0>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:14.446700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-3db9dbee-7116-4f86-bd65-a3e22baf9932 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Calling method '.version_select at 0x7ffa9d2f2820>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:14.540580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-3db9dbee-7116-4f86-bd65-a3e22baf9932 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] HTTP exception thrown: Volume 63595e87-4b5a-4b17-88ed-01e6426e0c5d could not be found. Jun 27 09:36:14.547125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-3db9dbee-7116-4f86-bd65-a3e22baf9932 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Request method failure captured: Jun 27 09:36:14.547125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: GET /compute/v2.1/os-volumes/63595e87-4b5a-4b17-88ed-01e6426e0c5d HTTP/1.1 Jun 27 09:36:14.547125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:36:14.547125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:36:14.547125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:36:14.547125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:36:14.547125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:36:14.547125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:36:14.547125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:36:14.547125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:36:14.547125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXoAYS2Om9STNAtMYCPMf-I6B0LVgvJ346Yws5PAB-rXAxhnbC2WMp4G09JxipaRWjgtOlIZM8eV50C23LzmFUB1J_YkKtU6qDUwhoqi-cdqLaJUoxJ_isjrSlqr808xPJnXk_Y6JnSqQYO40A4VmnMFv71O_bEduNWGjJYqoRz1c9I Jun 27 09:36:14.547125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:36:14.547125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:36:14.547125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:36:14.547125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:36:14.547125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:36:14.547125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:36:14.547125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: eb3c0fa49ea5424399304b9f9b18e866 Jun 27 09:36:14.547125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-180013553 Jun 27 09:36:14.547125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:36:14.547125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:36:14.548314 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb3c0fa49ea5424399304b9f9b18e866"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb3c0fa49ea5424399304b9f9b18e866"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/eb3c0fa49ea5424399304b9f9b18e866"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_eb3c0fa49ea5424399304b9f9b18e866", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:36:14.548314 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-VolumesSnapshotsTestJSON-180013553 Jun 27 09:36:14.548314 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: eb3c0fa49ea5424399304b9f9b18e866 Jun 27 09:36:14.548314 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-180013553 Jun 27 09:36:14.548314 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-VolumesSnapshotsTestJSON-180013553-project Jun 27 09:36:14.548314 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:36:14.548314 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:36:14.548314 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: 0e7a041f66e245189135fe8bedc93448 Jun 27 09:36:14.548314 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-VolumesSnapshotsTestJSON-180013553-project Jun 27 09:36:14.548314 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: Jun 27 09:36:14.548314 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Volume 63595e87-4b5a-4b17-88ed-01e6426e0c5d could not be found. Jun 27 09:36:14.548314 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'id': '63595e87-4b5a-4b17-88ed-01e6426e0c5d'} Jun 27 09:36:14.548314 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:36:14.549017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:36:14.549017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 09:36:14.549017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 09:36:14.549017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 09:36:14.549017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 09:36:14.549017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 09:36:14.549017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 09:36:14.549017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 09:36:14.549017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 09:36:14.549017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 09:36:14.549017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 09:36:14.549017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 09:36:14.549017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 09:36:14.549017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 09:36:14.549017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 09:36:14.549017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 63595e87-4b5a-4b17-88ed-01e6426e0c5d could not be found. (HTTP 404) (Request-ID: req-24a0575b-fa65-48c5-9ff7-5af27cddd7ca) Jun 27 09:36:14.549017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:14.549017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:36:14.549017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:14.549917 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:36:14.549917 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 09:36:14.549917 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 09:36:14.549917 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 09:36:14.549917 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 09:36:14.549917 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 09:36:14.549917 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 09:36:14.549917 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 09:36:14.549917 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 09:36:14.549917 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 09:36:14.549917 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 09:36:14.549917 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 09:36:14.549917 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 09:36:14.549917 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 09:36:14.549917 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 09:36:14.549917 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 09:36:14.549917 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 09:36:14.549917 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 09:36:14.549917 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 09:36:14.550993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 09:36:14.550993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 09:36:14.550993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 09:36:14.550993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 09:36:14.550993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 63595e87-4b5a-4b17-88ed-01e6426e0c5d could not be found. Jun 27 09:36:14.550993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:14.550993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:36:14.550993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:14.550993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:36:14.550993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:36:14.550993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:36:14.550993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:36:14.550993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:36:14.550993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 09:36:14.550993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 09:36:14.550993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:36:14.550993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:36:14.550993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 09:36:14.550993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:36:14.552994 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 63595e87-4b5a-4b17-88ed-01e6426e0c5d could not be found. Jun 27 09:36:14.552994 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:14.552994 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:36:14.552994 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:14.552994 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:36:14.552994 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:36:14.552994 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:36:14.552994 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:36:14.552994 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:36:14.552994 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 63595e87-4b5a-4b17-88ed-01e6426e0c5d could not be found. Jun 27 09:36:14.552994 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:14.552994 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-3db9dbee-7116-4f86-bd65-a3e22baf9932 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Returning 404 to user: Volume 63595e87-4b5a-4b17-88ed-01e6426e0c5d could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:36:14.552994 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-3db9dbee-7116-4f86-bd65-a3e22baf9932 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/63595e87-4b5a-4b17-88ed-01e6426e0c5d" status: 404 len: 109 microversion: 2.1 time: 0.114986 Jun 27 09:36:14.552994 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 13/24] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 27 09:36:14 2022] GET /compute/v2.1/os-volumes/63595e87-4b5a-4b17-88ed-01e6426e0c5d => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:36:14.572893 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-14f3d415-60e9-43f9-9d07-b4da2322da21 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Calling method '.version_select at 0x7ffa9dcd5940>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:14.582773 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-201ea80c-b79f-4594-a6bc-24ba0849e646 tempest-VolumesTestJSON-1708364433 tempest-VolumesTestJSON-1708364433-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.356874 Jun 27 09:36:14.598686 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 12/25] 10.222.0.64 () {58 vars in 1166 bytes} [Mon Jun 27 09:36:14 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:36:14.621687 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-58caa4a7-74a3-4f8a-8514-95210e9f7fb6 tempest-VolumesTestJSON-1708364433 tempest-VolumesTestJSON-1708364433-project] Calling method '.version_select at 0x7ffa9ca98040>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:14.658800 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-14f3d415-60e9-43f9-9d07-b4da2322da21 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] HTTP exception thrown: Volume 63595e87-4b5a-4b17-88ed-01e6426e0c5d could not be found. Jun 27 09:36:14.661343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-14f3d415-60e9-43f9-9d07-b4da2322da21 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Request method failure captured: Jun 27 09:36:14.661343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: DELETE /compute/v2.1/os-volumes/63595e87-4b5a-4b17-88ed-01e6426e0c5d HTTP/1.1 Jun 27 09:36:14.661343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:36:14.661343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:36:14.661343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:36:14.661343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:36:14.661343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:36:14.661343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:36:14.661343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:36:14.661343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:36:14.661343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXoAYS2Om9STNAtMYCPMf-I6B0LVgvJ346Yws5PAB-rXAxhnbC2WMp4G09JxipaRWjgtOlIZM8eV50C23LzmFUB1J_YkKtU6qDUwhoqi-cdqLaJUoxJ_isjrSlqr808xPJnXk_Y6JnSqQYO40A4VmnMFv71O_bEduNWGjJYqoRz1c9I Jun 27 09:36:14.661343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:36:14.661343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:36:14.661343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:36:14.661343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:36:14.661343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:36:14.661343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:36:14.661343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: eb3c0fa49ea5424399304b9f9b18e866 Jun 27 09:36:14.661343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-180013553 Jun 27 09:36:14.661343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:36:14.661343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:36:14.662627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb3c0fa49ea5424399304b9f9b18e866"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb3c0fa49ea5424399304b9f9b18e866"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/eb3c0fa49ea5424399304b9f9b18e866"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_eb3c0fa49ea5424399304b9f9b18e866", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:36:14.662627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-VolumesSnapshotsTestJSON-180013553 Jun 27 09:36:14.662627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: eb3c0fa49ea5424399304b9f9b18e866 Jun 27 09:36:14.662627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-180013553 Jun 27 09:36:14.662627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-VolumesSnapshotsTestJSON-180013553-project Jun 27 09:36:14.662627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:36:14.662627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:36:14.662627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: 0e7a041f66e245189135fe8bedc93448 Jun 27 09:36:14.662627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-VolumesSnapshotsTestJSON-180013553-project Jun 27 09:36:14.662627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: Jun 27 09:36:14.662627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Volume 63595e87-4b5a-4b17-88ed-01e6426e0c5d could not be found. Jun 27 09:36:14.662627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'id': '63595e87-4b5a-4b17-88ed-01e6426e0c5d'} Jun 27 09:36:14.662627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:36:14.664294 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:36:14.664294 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 09:36:14.664294 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 09:36:14.664294 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 09:36:14.664294 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 09:36:14.664294 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 09:36:14.664294 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 09:36:14.664294 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 09:36:14.664294 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 09:36:14.664294 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 09:36:14.664294 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 09:36:14.664294 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 09:36:14.664294 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 09:36:14.664294 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 09:36:14.664294 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 09:36:14.664294 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 63595e87-4b5a-4b17-88ed-01e6426e0c5d could not be found. (HTTP 404) (Request-ID: req-00e53742-d662-4615-8f57-e0d6a07ef6bb) Jun 27 09:36:14.664294 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:14.664294 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:36:14.664294 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:14.665401 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:36:14.665401 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 27 09:36:14.665401 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 27 09:36:14.665401 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 09:36:14.665401 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 09:36:14.665401 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 09:36:14.665401 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 09:36:14.665401 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 09:36:14.665401 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 09:36:14.665401 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 09:36:14.665401 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 09:36:14.665401 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 09:36:14.665401 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 09:36:14.665401 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 09:36:14.665401 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 09:36:14.665401 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 09:36:14.665401 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 09:36:14.665401 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 09:36:14.665401 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 09:36:14.666973 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 09:36:14.666973 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 09:36:14.666973 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 09:36:14.666973 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 09:36:14.666973 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 63595e87-4b5a-4b17-88ed-01e6426e0c5d could not be found. Jun 27 09:36:14.666973 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:14.666973 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:36:14.666973 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:14.666973 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:36:14.666973 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:36:14.666973 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:36:14.666973 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:36:14.666973 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:36:14.666973 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 09:36:14.666973 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 09:36:14.666973 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:36:14.666973 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:36:14.666973 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 27 09:36:14.666973 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:36:14.668196 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 63595e87-4b5a-4b17-88ed-01e6426e0c5d could not be found. Jun 27 09:36:14.668196 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:14.668196 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:36:14.668196 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:14.668196 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:36:14.668196 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:36:14.668196 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:36:14.668196 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:36:14.668196 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:36:14.668196 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 63595e87-4b5a-4b17-88ed-01e6426e0c5d could not be found. Jun 27 09:36:14.668196 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:14.668196 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-14f3d415-60e9-43f9-9d07-b4da2322da21 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Returning 404 to user: Volume 63595e87-4b5a-4b17-88ed-01e6426e0c5d could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:36:14.668196 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-14f3d415-60e9-43f9-9d07-b4da2322da21 tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/63595e87-4b5a-4b17-88ed-01e6426e0c5d" status: 404 len: 109 microversion: 2.1 time: 0.105456 Jun 27 09:36:14.669671 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 14/26] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jun 27 09:36:14 2022] DELETE /compute/v2.1/os-volumes/63595e87-4b5a-4b17-88ed-01e6426e0c5d => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:36:14.680946 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f47ee5e3-90e2-49b7-9e6f-40437e9e8deb tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Calling method '.version_select at 0x7ffa9dcd5af0>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:14.762228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-f47ee5e3-90e2-49b7-9e6f-40437e9e8deb tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] HTTP exception thrown: Volume 63595e87-4b5a-4b17-88ed-01e6426e0c5d could not be found. Jun 27 09:36:14.762228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f47ee5e3-90e2-49b7-9e6f-40437e9e8deb tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Request method failure captured: Jun 27 09:36:14.762228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: GET /compute/v2.1/os-volumes/63595e87-4b5a-4b17-88ed-01e6426e0c5d HTTP/1.1 Jun 27 09:36:14.762228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:36:14.762228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:36:14.762228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:36:14.762228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:36:14.762228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:36:14.762228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:36:14.762228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:36:14.762228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:36:14.762228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXoAYS2Om9STNAtMYCPMf-I6B0LVgvJ346Yws5PAB-rXAxhnbC2WMp4G09JxipaRWjgtOlIZM8eV50C23LzmFUB1J_YkKtU6qDUwhoqi-cdqLaJUoxJ_isjrSlqr808xPJnXk_Y6JnSqQYO40A4VmnMFv71O_bEduNWGjJYqoRz1c9I Jun 27 09:36:14.762228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:36:14.762228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:36:14.762228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:36:14.762228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:36:14.762228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:36:14.762228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:36:14.762228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: eb3c0fa49ea5424399304b9f9b18e866 Jun 27 09:36:14.762228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-180013553 Jun 27 09:36:14.762228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:36:14.762228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:36:14.764141 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb3c0fa49ea5424399304b9f9b18e866"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/eb3c0fa49ea5424399304b9f9b18e866"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/eb3c0fa49ea5424399304b9f9b18e866"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_eb3c0fa49ea5424399304b9f9b18e866", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:36:14.764141 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-VolumesSnapshotsTestJSON-180013553 Jun 27 09:36:14.764141 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: eb3c0fa49ea5424399304b9f9b18e866 Jun 27 09:36:14.764141 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-180013553 Jun 27 09:36:14.764141 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-VolumesSnapshotsTestJSON-180013553-project Jun 27 09:36:14.764141 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:36:14.764141 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:36:14.764141 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: 0e7a041f66e245189135fe8bedc93448 Jun 27 09:36:14.764141 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-VolumesSnapshotsTestJSON-180013553-project Jun 27 09:36:14.764141 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: Jun 27 09:36:14.764141 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Volume 63595e87-4b5a-4b17-88ed-01e6426e0c5d could not be found. Jun 27 09:36:14.764141 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'id': '63595e87-4b5a-4b17-88ed-01e6426e0c5d'} Jun 27 09:36:14.764141 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:36:14.764798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:36:14.764798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 09:36:14.764798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 09:36:14.764798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 09:36:14.764798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 09:36:14.764798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 09:36:14.764798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 09:36:14.764798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 09:36:14.764798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 09:36:14.764798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 09:36:14.764798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 09:36:14.764798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 09:36:14.764798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 09:36:14.764798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 09:36:14.764798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 09:36:14.764798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 63595e87-4b5a-4b17-88ed-01e6426e0c5d could not be found. (HTTP 404) (Request-ID: req-1d606bc5-fdfc-4eb2-8102-b6a86849c70c) Jun 27 09:36:14.764798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:14.764798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:36:14.764798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:14.765700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:36:14.765700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 09:36:14.765700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 09:36:14.765700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 09:36:14.765700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 09:36:14.765700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 09:36:14.765700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 09:36:14.765700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 09:36:14.765700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 09:36:14.765700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 09:36:14.765700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 09:36:14.765700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 09:36:14.765700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 09:36:14.765700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 09:36:14.765700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 09:36:14.765700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 09:36:14.765700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 09:36:14.765700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 09:36:14.765700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 09:36:14.766580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 09:36:14.766580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 09:36:14.766580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 09:36:14.766580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 09:36:14.766580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 63595e87-4b5a-4b17-88ed-01e6426e0c5d could not be found. Jun 27 09:36:14.766580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:14.766580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:36:14.766580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:14.766580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:36:14.766580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:36:14.766580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:36:14.766580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:36:14.766580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:36:14.766580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 09:36:14.766580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 09:36:14.766580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:36:14.766580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:36:14.766580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 09:36:14.766580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:36:14.767462 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 63595e87-4b5a-4b17-88ed-01e6426e0c5d could not be found. Jun 27 09:36:14.767462 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:14.767462 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:36:14.767462 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:14.767462 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:36:14.767462 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:36:14.767462 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:36:14.767462 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:36:14.767462 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:36:14.767462 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 63595e87-4b5a-4b17-88ed-01e6426e0c5d could not be found. Jun 27 09:36:14.767462 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:36:14.767462 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f47ee5e3-90e2-49b7-9e6f-40437e9e8deb tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] Returning 404 to user: Volume 63595e87-4b5a-4b17-88ed-01e6426e0c5d could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:36:14.767462 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-f47ee5e3-90e2-49b7-9e6f-40437e9e8deb tempest-VolumesSnapshotsTestJSON-180013553 tempest-VolumesSnapshotsTestJSON-180013553-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/63595e87-4b5a-4b17-88ed-01e6426e0c5d" status: 404 len: 109 microversion: 2.1 time: 0.087088 Jun 27 09:36:14.768519 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 15/27] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 27 09:36:14 2022] GET /compute/v2.1/os-volumes/63595e87-4b5a-4b17-88ed-01e6426e0c5d => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:36:14.802462 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-58caa4a7-74a3-4f8a-8514-95210e9f7fb6 tempest-VolumesTestJSON-1708364433 tempest-VolumesTestJSON-1708364433-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.194335 Jun 27 09:36:14.811707 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 13/28] 10.222.0.64 () {58 vars in 1169 bytes} [Mon Jun 27 09:36:14 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:36:14.817743 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-1777c307-9d09-49fd-88fe-4173001866d0 tempest-VolumesTestJSON-1708364433 tempest-VolumesTestJSON-1708364433-project] Calling method '.version_select at 0x7ffa9d2f28b0>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:15.000357 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-1777c307-9d09-49fd-88fe-4173001866d0 tempest-VolumesTestJSON-1708364433 tempest-VolumesTestJSON-1708364433-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.187419 Jun 27 09:36:15.000928 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 16/29] 10.222.0.64 () {58 vars in 1154 bytes} [Mon Jun 27 09:36:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:36:15.016857 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-86fdd160-81c8-45e6-b81b-d503fd76b950 tempest-VolumesTestJSON-1708364433 tempest-VolumesTestJSON-1708364433-project] Calling method '.version_select at 0x7ffa9ca8e670>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:15.177072 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-86fdd160-81c8-45e6-b81b-d503fd76b950 tempest-VolumesTestJSON-1708364433 tempest-VolumesTestJSON-1708364433-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.163477 Jun 27 09:36:15.189080 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 14/30] 10.222.0.64 () {58 vars in 1187 bytes} [Mon Jun 27 09:36:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:36:15.192034 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-54c25119-75bd-4d8f-9e96-87300a7bd95a tempest-VolumesTestJSON-1708364433 tempest-VolumesTestJSON-1708364433-project] Calling method '.version_select at 0x7ffa9d2fd280>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:15.451916 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-54c25119-75bd-4d8f-9e96-87300a7bd95a tempest-VolumesTestJSON-1708364433 tempest-VolumesTestJSON-1708364433-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.263690 Jun 27 09:36:15.453563 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 17/31] 10.222.0.64 () {58 vars in 1154 bytes} [Mon Jun 27 09:36:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:36:16.405899 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c5a94301-46c5-4cbc-a871-8cb08a89bf12 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-979453166", "imageRef": "96dfa32c-d52f-4225-8918-743ebc97f4bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:36:16.601831 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.network.neutron [None req-c5a94301-46c5-4cbc-a871-8cb08a89bf12 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] validate_networks() for [('8135fe8c-03ea-49b7-8f4d-5a328bf8b692', None, None, None, None, None)] {{(pid=124870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 09:36:16.781180 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-fd2e30c5-787e-47aa-a1dc-fd62b73be8c5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2147356855", "imageRef": "96dfa32c-d52f-4225-8918-743ebc97f4bc", "flavorRef": "452", "networks": [{"uuid": "9db8f8bc-db53-4737-8355-45174efdae65"}]}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:36:17.048243 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.network.neutron [None req-fd2e30c5-787e-47aa-a1dc-fd62b73be8c5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] validate_networks() for [('9db8f8bc-db53-4737-8355-45174efdae65', None, None, None, None, None)] {{(pid=124869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 09:36:18.394950 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-c5a94301-46c5-4cbc-a871-8cb08a89bf12 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Flavor limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 09:36:18.396355 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-c5a94301-46c5-4cbc-a871-8cb08a89bf12 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Image limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 09:36:18.396982 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-c5a94301-46c5-4cbc-a871-8cb08a89bf12 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Flavor pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 09:36:18.397529 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-c5a94301-46c5-4cbc-a871-8cb08a89bf12 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Image pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 09:36:18.398475 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-c5a94301-46c5-4cbc-a871-8cb08a89bf12 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 09:36:18.410540 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c5a94301-46c5-4cbc-a871-8cb08a89bf12 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:18.415700 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c5a94301-46c5-4cbc-a871-8cb08a89bf12 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:18.415700 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c5a94301-46c5-4cbc-a871-8cb08a89bf12 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:18.415700 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c5a94301-46c5-4cbc-a871-8cb08a89bf12 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:18.451923 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-c5a94301-46c5-4cbc-a871-8cb08a89bf12 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Getting quotas for project 6a50c1d09d3247728aa1ef9fb69463fc. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:36:18.457227 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-c5a94301-46c5-4cbc-a871-8cb08a89bf12 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Getting quotas for user 41ce5cc7ff504d64aac73e48097a4b01 and project 6a50c1d09d3247728aa1ef9fb69463fc. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:36:18.477347 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-c5a94301-46c5-4cbc-a871-8cb08a89bf12 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Going to run 1 instances... {{(pid=124870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 09:36:18.486734 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-c5a94301-46c5-4cbc-a871-8cb08a89bf12 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96dfa32c-d52f-4225-8918-743ebc97f4bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 09:36:18.690181 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-fd2e30c5-787e-47aa-a1dc-fd62b73be8c5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Flavor limits 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 09:36:18.691172 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-fd2e30c5-787e-47aa-a1dc-fd62b73be8c5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Image limits 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 09:36:18.691875 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-fd2e30c5-787e-47aa-a1dc-fd62b73be8c5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Flavor pref 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 09:36:18.692435 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-fd2e30c5-787e-47aa-a1dc-fd62b73be8c5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Image pref 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 09:36:18.693024 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-fd2e30c5-787e-47aa-a1dc-fd62b73be8c5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 09:36:18.719961 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fd2e30c5-787e-47aa-a1dc-fd62b73be8c5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:18.720422 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fd2e30c5-787e-47aa-a1dc-fd62b73be8c5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:18.721243 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fd2e30c5-787e-47aa-a1dc-fd62b73be8c5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:18.721773 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fd2e30c5-787e-47aa-a1dc-fd62b73be8c5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:18.791473 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-c5a94301-46c5-4cbc-a871-8cb08a89bf12 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.159892 Jun 27 09:36:18.796362 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 15/32] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 27 09:36:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 3166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 09:36:18.806555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-fd2e30c5-787e-47aa-a1dc-fd62b73be8c5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Getting quotas for project 84dd698260134176acd4f4892911ab05. Resources: {'ram', 'instances', 'cores'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:36:18.813835 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-336fcea7-ad23-467a-bdf5-a0901164f71e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-916619627", "imageRef": "96dfa32c-d52f-4225-8918-743ebc97f4bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7ad0500a-ea93-4b00-b42a-06ba39611c6e"}], "security_groups": [{"name": "tempest-securitygroup--1453864590"}], "key_name": "tempest-keypair-1478563327", "user_data": "}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:36:18.816853 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-fd2e30c5-787e-47aa-a1dc-fd62b73be8c5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Getting quotas for user 9b5d5a3f43c544368118125f2e194565 and project 84dd698260134176acd4f4892911ab05. Resources: {'ram', 'instances', 'cores'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:36:18.879221 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-fd2e30c5-787e-47aa-a1dc-fd62b73be8c5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Going to run 1 instances... {{(pid=124869) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 09:36:18.882481 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-fd2e30c5-787e-47aa-a1dc-fd62b73be8c5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96dfa32c-d52f-4225-8918-743ebc97f4bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 09:36:19.137096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.network.neutron [None req-336fcea7-ad23-467a-bdf5-a0901164f71e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] validate_networks() for [('7ad0500a-ea93-4b00-b42a-06ba39611c6e', None, None, None, None, None)] {{(pid=124870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 09:36:19.212949 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-fd2e30c5-787e-47aa-a1dc-fd62b73be8c5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.246286 Jun 27 09:36:19.214263 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 18/33] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 27 09:36:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 09:36:19.233802 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-0a0827ed-f401-42d1-ae9b-d8cdd77aa782 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:19.241739 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-0a0827ed-f401-42d1-ae9b-d8cdd77aa782 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:19.461381 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-0a0827ed-f401-42d1-ae9b-d8cdd77aa782 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:19.477898 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-0a0827ed-f401-42d1-ae9b-d8cdd77aa782 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1221 microversion: 2.1 time: 0.262175 Jun 27 09:36:19.478719 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 19/34] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:19 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1221 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:19.483629 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f469fabe-f89b-4cfb-921a-6fc30aebce0a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:19.484959 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-f469fabe-f89b-4cfb-921a-6fc30aebce0a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:19.593531 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f469fabe-f89b-4cfb-921a-6fc30aebce0a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:19.608959 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-f469fabe-f89b-4cfb-921a-6fc30aebce0a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1215 microversion: 2.1 time: 0.119458 Jun 27 09:36:19.609891 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 20/35] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:19 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1215 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:19.870968 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-d18f06de-6516-462d-b03c-c5562e04231f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1918608545", "imageRef": "96dfa32c-d52f-4225-8918-743ebc97f4bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:36:19.972216 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.network.neutron [None req-d18f06de-6516-462d-b03c-c5562e04231f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] validate_networks() for [('8135fe8c-03ea-49b7-8f4d-5a328bf8b692', None, None, None, None, None)] {{(pid=124869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 09:36:20.188761 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-336fcea7-ad23-467a-bdf5-a0901164f71e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Flavor limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 09:36:20.189235 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-336fcea7-ad23-467a-bdf5-a0901164f71e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Image limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 09:36:20.189846 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-336fcea7-ad23-467a-bdf5-a0901164f71e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Flavor pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 09:36:20.190457 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-336fcea7-ad23-467a-bdf5-a0901164f71e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Image pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 09:36:20.190947 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-336fcea7-ad23-467a-bdf5-a0901164f71e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 09:36:20.205455 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-336fcea7-ad23-467a-bdf5-a0901164f71e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:20.205902 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-336fcea7-ad23-467a-bdf5-a0901164f71e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:20.209697 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-336fcea7-ad23-467a-bdf5-a0901164f71e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:20.210887 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-336fcea7-ad23-467a-bdf5-a0901164f71e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:20.245103 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-336fcea7-ad23-467a-bdf5-a0901164f71e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Getting quotas for project 79203b0660c041f49c5f2629bd5a0bdf. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:36:20.262801 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-336fcea7-ad23-467a-bdf5-a0901164f71e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Getting quotas for user ecf085030e8e4a65a7140fea2b64a7ed and project 79203b0660c041f49c5f2629bd5a0bdf. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:36:20.293359 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-336fcea7-ad23-467a-bdf5-a0901164f71e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Going to run 1 instances... {{(pid=124870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 09:36:20.295846 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-336fcea7-ad23-467a-bdf5-a0901164f71e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96dfa32c-d52f-4225-8918-743ebc97f4bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 09:36:20.606098 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-336fcea7-ad23-467a-bdf5-a0901164f71e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.806796 Jun 27 09:36:20.615114 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 16/36] 10.222.0.64 () {62 vars in 1187 bytes} [Mon Jun 27 09:36:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 1817 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 27 09:36:20.622568 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a8e3b57d-de3a-4a99-8cb9-c03b2d0e47ab tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:20.625401 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-a8e3b57d-de3a-4a99-8cb9-c03b2d0e47ab tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:20.793825 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-d18f06de-6516-462d-b03c-c5562e04231f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Flavor limits 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 09:36:20.794401 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-d18f06de-6516-462d-b03c-c5562e04231f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Image limits 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 09:36:20.795326 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-d18f06de-6516-462d-b03c-c5562e04231f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Flavor pref 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 09:36:20.795907 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-d18f06de-6516-462d-b03c-c5562e04231f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Image pref 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 09:36:20.796765 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-d18f06de-6516-462d-b03c-c5562e04231f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 09:36:20.807939 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a8e3b57d-de3a-4a99-8cb9-c03b2d0e47ab tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:20.813757 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d18f06de-6516-462d-b03c-c5562e04231f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:20.816587 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d18f06de-6516-462d-b03c-c5562e04231f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:20.817060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d18f06de-6516-462d-b03c-c5562e04231f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:20.817546 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d18f06de-6516-462d-b03c-c5562e04231f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:20.845649 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-d18f06de-6516-462d-b03c-c5562e04231f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Getting quotas for project 6a50c1d09d3247728aa1ef9fb69463fc. Resources: {'ram', 'instances', 'cores'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:36:20.845845 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a8e3b57d-de3a-4a99-8cb9-c03b2d0e47ab tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:20.849425 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a8e3b57d-de3a-4a99-8cb9-c03b2d0e47ab tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:20.853054 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-d18f06de-6516-462d-b03c-c5562e04231f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Getting quotas for user 41ce5cc7ff504d64aac73e48097a4b01 and project 6a50c1d09d3247728aa1ef9fb69463fc. Resources: {'ram', 'instances', 'cores'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:36:20.855563 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-a8e3b57d-de3a-4a99-8cb9-c03b2d0e47ab tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1281 microversion: 2.20 time: 0.236531 Jun 27 09:36:20.856465 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 17/37] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:20 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1281 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:36:20.871694 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-ffe786be-f8fe-45be-84cd-8810d254be33 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:20.872565 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-ffe786be-f8fe-45be-84cd-8810d254be33 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:20.878551 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-d18f06de-6516-462d-b03c-c5562e04231f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Going to run 1 instances... {{(pid=124869) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 09:36:20.880800 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-d18f06de-6516-462d-b03c-c5562e04231f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96dfa32c-d52f-4225-8918-743ebc97f4bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 09:36:21.007554 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-ffe786be-f8fe-45be-84cd-8810d254be33 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:21.016481 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-ffe786be-f8fe-45be-84cd-8810d254be33 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1215 microversion: 2.1 time: 0.158702 Jun 27 09:36:21.018151 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 18/38] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:20 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:21.059512 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-d18f06de-6516-462d-b03c-c5562e04231f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.193686 Jun 27 09:36:21.060485 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 21/39] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 27 09:36:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 1195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 09:36:21.074147 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-9282bc86-a06a-47bb-b859-4f74a7761a2f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:21.074986 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-9282bc86-a06a-47bb-b859-4f74a7761a2f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:21.229927 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-9282bc86-a06a-47bb-b859-4f74a7761a2f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:21.241110 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-9282bc86-a06a-47bb-b859-4f74a7761a2f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1222 microversion: 2.1 time: 0.171329 Jun 27 09:36:21.242919 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 19/40] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:21 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1222 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:21.876727 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f18f9c9f-ea1e-41c4-9276-8798d8915a42 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:21.877350 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-f18f9c9f-ea1e-41c4-9276-8798d8915a42 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:21.978394 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f18f9c9f-ea1e-41c4-9276-8798d8915a42 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:21.988889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f18f9c9f-ea1e-41c4-9276-8798d8915a42 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:21.990788 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f18f9c9f-ea1e-41c4-9276-8798d8915a42 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:21.993404 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-f18f9c9f-ea1e-41c4-9276-8798d8915a42 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1281 microversion: 2.20 time: 0.122141 Jun 27 09:36:21.994110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 22/41] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:21 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1281 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:36:22.034199 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-39355a34-b3ef-42f2-8b49-2e1883745eb5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:22.035266 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-39355a34-b3ef-42f2-8b49-2e1883745eb5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:22.056502 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-39355a34-b3ef-42f2-8b49-2e1883745eb5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:22.056982 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-39355a34-b3ef-42f2-8b49-2e1883745eb5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:22.057800 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-39355a34-b3ef-42f2-8b49-2e1883745eb5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:22.058252 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-39355a34-b3ef-42f2-8b49-2e1883745eb5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:22.262620 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-d8a4eb6d-f373-40d5-994f-640702c4dd9c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:22.263288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-d8a4eb6d-f373-40d5-994f-640702c4dd9c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:22.295447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-39355a34-b3ef-42f2-8b49-2e1883745eb5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:22.318549 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-39355a34-b3ef-42f2-8b49-2e1883745eb5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1219 microversion: 2.1 time: 0.287881 Jun 27 09:36:22.320731 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 20/42] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:22 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1219 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:22.426232 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-d8a4eb6d-f373-40d5-994f-640702c4dd9c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:22.442385 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-d8a4eb6d-f373-40d5-994f-640702c4dd9c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1222 microversion: 2.1 time: 0.186840 Jun 27 09:36:22.447254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 23/43] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:22 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1222 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:36:23.014023 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-b2eec2f6-29a3-4772-94dc-545b41422153 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:23.014757 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-b2eec2f6-29a3-4772-94dc-545b41422153 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:23.021806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b2eec2f6-29a3-4772-94dc-545b41422153 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:23.022257 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b2eec2f6-29a3-4772-94dc-545b41422153 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:23.024599 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b2eec2f6-29a3-4772-94dc-545b41422153 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:23.025039 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b2eec2f6-29a3-4772-94dc-545b41422153 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:23.254376 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-b2eec2f6-29a3-4772-94dc-545b41422153 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:23.271578 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-b2eec2f6-29a3-4772-94dc-545b41422153 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:23.274107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-b2eec2f6-29a3-4772-94dc-545b41422153 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:23.275645 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-b2eec2f6-29a3-4772-94dc-545b41422153 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1277 microversion: 2.20 time: 0.267758 Jun 27 09:36:23.286678 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 24/44] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:23 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1277 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:36:23.334754 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-721113e5-9db1-41d9-8273-028a5388074a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:23.336044 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-721113e5-9db1-41d9-8273-028a5388074a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:23.344654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-721113e5-9db1-41d9-8273-028a5388074a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:23.345343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-721113e5-9db1-41d9-8273-028a5388074a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:23.346980 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-721113e5-9db1-41d9-8273-028a5388074a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:23.347613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-721113e5-9db1-41d9-8273-028a5388074a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:23.455969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-721113e5-9db1-41d9-8273-028a5388074a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:23.470670 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-721113e5-9db1-41d9-8273-028a5388074a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1267 microversion: 2.1 time: 0.139664 Jun 27 09:36:23.473368 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 25/45] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:23 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1267 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:36:23.483379 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-9aa37423-9285-4ac6-bbcc-5ba1c9e15a43 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:23.490671 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-9aa37423-9285-4ac6-bbcc-5ba1c9e15a43 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:23.504171 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9aa37423-9285-4ac6-bbcc-5ba1c9e15a43 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:23.507089 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9aa37423-9285-4ac6-bbcc-5ba1c9e15a43 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:23.508024 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9aa37423-9285-4ac6-bbcc-5ba1c9e15a43 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:23.510798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9aa37423-9285-4ac6-bbcc-5ba1c9e15a43 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:23.645947 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-9aa37423-9285-4ac6-bbcc-5ba1c9e15a43 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:23.655172 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-9aa37423-9285-4ac6-bbcc-5ba1c9e15a43 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1218 microversion: 2.1 time: 0.180574 Jun 27 09:36:23.667582 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 26/46] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:23 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1218 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:23.780043 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-fbc9cdca-bd39-44ec-909e-f4aae1016785 tempest-VolumesGetTestJSON-2056958609 tempest-VolumesGetTestJSON-2056958609-project] Action: 'create', calling method: .version_select at 0x7ffa9c1f1550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-871411407", "metadata": {"Type": "work"}}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:36:24.298262 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-9b3600c1-3eff-4ecd-a778-411d55e96d0f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:24.300476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-9b3600c1-3eff-4ecd-a778-411d55e96d0f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:24.311008 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9b3600c1-3eff-4ecd-a778-411d55e96d0f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:24.311459 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9b3600c1-3eff-4ecd-a778-411d55e96d0f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:24.317357 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9b3600c1-3eff-4ecd-a778-411d55e96d0f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:24.320089 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9b3600c1-3eff-4ecd-a778-411d55e96d0f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:24.490990 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-9b3600c1-3eff-4ecd-a778-411d55e96d0f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:24.499162 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-9b3600c1-3eff-4ecd-a778-411d55e96d0f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:24.500776 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-9b3600c1-3eff-4ecd-a778-411d55e96d0f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:24.502828 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-9b3600c1-3eff-4ecd-a778-411d55e96d0f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1333 microversion: 2.20 time: 0.212450 Jun 27 09:36:24.503788 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 27/47] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:24 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1333 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:36:24.520261 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-d78a9acc-1b78-467c-b99f-af3b47516a60 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:24.521090 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-d78a9acc-1b78-467c-b99f-af3b47516a60 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:24.529679 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d78a9acc-1b78-467c-b99f-af3b47516a60 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:24.530595 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d78a9acc-1b78-467c-b99f-af3b47516a60 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:24.532191 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d78a9acc-1b78-467c-b99f-af3b47516a60 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:24.532191 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d78a9acc-1b78-467c-b99f-af3b47516a60 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:24.599250 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-d78a9acc-1b78-467c-b99f-af3b47516a60 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:24.613083 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-d78a9acc-1b78-467c-b99f-af3b47516a60 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1275 microversion: 2.1 time: 0.108150 Jun 27 09:36:24.614687 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 28/48] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:24 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1275 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:24.663030 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-fbc9cdca-bd39-44ec-909e-f4aae1016785 tempest-VolumesGetTestJSON-2056958609 tempest-VolumesGetTestJSON-2056958609-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.754189 Jun 27 09:36:24.670230 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 21/49] 10.222.0.64 () {60 vars in 1155 bytes} [Mon Jun 27 09:36:22 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1757 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 27 09:36:24.676924 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c967d5d4-9db0-4815-b684-09339db39398 tempest-VolumesGetTestJSON-2056958609 tempest-VolumesGetTestJSON-2056958609-project] Calling method '.version_select at 0x7ffa9c111a60>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:24.681138 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-d03b46e7-9fae-4aa6-b937-2fa89eadb6ce tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:24.682138 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-d03b46e7-9fae-4aa6-b937-2fa89eadb6ce tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:24.698639 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d03b46e7-9fae-4aa6-b937-2fa89eadb6ce tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:24.699160 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d03b46e7-9fae-4aa6-b937-2fa89eadb6ce tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:24.700038 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d03b46e7-9fae-4aa6-b937-2fa89eadb6ce tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:24.702175 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d03b46e7-9fae-4aa6-b937-2fa89eadb6ce tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:24.792149 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-c967d5d4-9db0-4815-b684-09339db39398 tempest-VolumesGetTestJSON-2056958609 tempest-VolumesGetTestJSON-2056958609-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/1d042fa9-191b-4bb0-a2be-b666a1b5ea55" status: 200 len: 352 microversion: 2.1 time: 0.120425 Jun 27 09:36:24.793893 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 22/50] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 27 09:36:24 2022] GET /compute/v2.1/os-volumes/1d042fa9-191b-4bb0-a2be-b666a1b5ea55 => generated 352 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:36:24.871726 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-d03b46e7-9fae-4aa6-b937-2fa89eadb6ce tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:24.896730 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-d03b46e7-9fae-4aa6-b937-2fa89eadb6ce tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1274 microversion: 2.1 time: 0.228287 Jun 27 09:36:24.898676 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 29/51] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:24 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1274 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:25.523996 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-aceb46ff-6222-4286-8399-8985f11a148d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:25.524993 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-aceb46ff-6222-4286-8399-8985f11a148d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:25.546050 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-aceb46ff-6222-4286-8399-8985f11a148d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:25.546515 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-aceb46ff-6222-4286-8399-8985f11a148d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:25.547318 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-aceb46ff-6222-4286-8399-8985f11a148d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:25.547794 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-aceb46ff-6222-4286-8399-8985f11a148d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:25.636142 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-59d48326-335d-44bd-9a16-1bc15fe9fffc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:25.637408 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-59d48326-335d-44bd-9a16-1bc15fe9fffc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:25.646451 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-59d48326-335d-44bd-9a16-1bc15fe9fffc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:25.650409 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-59d48326-335d-44bd-9a16-1bc15fe9fffc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:25.651310 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-59d48326-335d-44bd-9a16-1bc15fe9fffc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:25.651809 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-59d48326-335d-44bd-9a16-1bc15fe9fffc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:25.778986 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-aceb46ff-6222-4286-8399-8985f11a148d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:25.796541 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-aceb46ff-6222-4286-8399-8985f11a148d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:25.799479 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-aceb46ff-6222-4286-8399-8985f11a148d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:25.801302 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-aceb46ff-6222-4286-8399-8985f11a148d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1339 microversion: 2.20 time: 0.283630 Jun 27 09:36:25.802064 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 23/52] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:25 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1339 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:36:25.817655 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-007c79d4-b2c5-439b-b969-0e9c4fe56b72 tempest-VolumesGetTestJSON-2056958609 tempest-VolumesGetTestJSON-2056958609-project] Calling method '.version_select at 0x7ffa9c186d30>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:25.886629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-007c79d4-b2c5-439b-b969-0e9c4fe56b72 tempest-VolumesGetTestJSON-2056958609 tempest-VolumesGetTestJSON-2056958609-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/1d042fa9-191b-4bb0-a2be-b666a1b5ea55" status: 200 len: 353 microversion: 2.1 time: 0.083337 Jun 27 09:36:25.888891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 24/53] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 27 09:36:25 2022] GET /compute/v2.1/os-volumes/1d042fa9-191b-4bb0-a2be-b666a1b5ea55 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:36:25.897107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-59d48326-335d-44bd-9a16-1bc15fe9fffc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:25.899497 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-81a3e0dc-0f88-4b01-b29d-361b0269ff6d tempest-VolumesGetTestJSON-2056958609 tempest-VolumesGetTestJSON-2056958609-project] Calling method '.version_select at 0x7ffa9c1340d0>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:25.914868 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-59d48326-335d-44bd-9a16-1bc15fe9fffc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1273 microversion: 2.1 time: 0.279360 Jun 27 09:36:25.914868 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 30/54] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:25 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1273 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:25.936189 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-0acac28c-829b-43a0-aea6-9bd86ef667ae tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:25.937311 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-0acac28c-829b-43a0-aea6-9bd86ef667ae tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:25.951108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0acac28c-829b-43a0-aea6-9bd86ef667ae tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:25.954801 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0acac28c-829b-43a0-aea6-9bd86ef667ae tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:25.960288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0acac28c-829b-43a0-aea6-9bd86ef667ae tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:25.960937 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0acac28c-829b-43a0-aea6-9bd86ef667ae tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:25.982287 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-81a3e0dc-0f88-4b01-b29d-361b0269ff6d tempest-VolumesGetTestJSON-2056958609 tempest-VolumesGetTestJSON-2056958609-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/1d042fa9-191b-4bb0-a2be-b666a1b5ea55" status: 200 len: 353 microversion: 2.1 time: 0.087168 Jun 27 09:36:25.990060 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 25/55] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 27 09:36:25 2022] GET /compute/v2.1/os-volumes/1d042fa9-191b-4bb0-a2be-b666a1b5ea55 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:36:26.012439 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-5a05d896-c2c1-4491-9b2c-dacd80c41aca tempest-VolumesGetTestJSON-2056958609 tempest-VolumesGetTestJSON-2056958609-project] Calling method '.version_select at 0x7ffa9c0cd310>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:26.194335 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-0acac28c-829b-43a0-aea6-9bd86ef667ae tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:26.202996 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-0acac28c-829b-43a0-aea6-9bd86ef667ae tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1280 microversion: 2.1 time: 0.276300 Jun 27 09:36:26.215917 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 31/56] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:25 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1280 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:26.278985 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-5a05d896-c2c1-4491-9b2c-dacd80c41aca tempest-VolumesGetTestJSON-2056958609 tempest-VolumesGetTestJSON-2056958609-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/1d042fa9-191b-4bb0-a2be-b666a1b5ea55" status: 202 len: 0 microversion: 2.1 time: 0.274050 Jun 27 09:36:26.282399 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 26/57] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jun 27 09:36:26 2022] DELETE /compute/v2.1/os-volumes/1d042fa9-191b-4bb0-a2be-b666a1b5ea55 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:36:26.288814 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-10ce838e-b940-4ccb-a91f-3e0ee95c6f35 tempest-VolumesGetTestJSON-2056958609 tempest-VolumesGetTestJSON-2056958609-project] Calling method '.version_select at 0x7ffa9c1a6550>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:26.388696 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-10ce838e-b940-4ccb-a91f-3e0ee95c6f35 tempest-VolumesGetTestJSON-2056958609 tempest-VolumesGetTestJSON-2056958609-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/1d042fa9-191b-4bb0-a2be-b666a1b5ea55" status: 200 len: 352 microversion: 2.1 time: 0.104867 Jun 27 09:36:26.389264 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 32/58] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 27 09:36:26 2022] GET /compute/v2.1/os-volumes/1d042fa9-191b-4bb0-a2be-b666a1b5ea55 => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:36:26.822326 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-fe86cd85-4c7b-4507-acd1-a807c27a4d2f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:26.823632 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-fe86cd85-4c7b-4507-acd1-a807c27a4d2f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:26.833391 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fe86cd85-4c7b-4507-acd1-a807c27a4d2f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:26.834218 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fe86cd85-4c7b-4507-acd1-a807c27a4d2f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:26.836438 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fe86cd85-4c7b-4507-acd1-a807c27a4d2f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:26.838408 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fe86cd85-4c7b-4507-acd1-a807c27a4d2f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:26.930054 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-78a7b2e5-8af6-4534-86ff-712e132a95da tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:26.930647 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-78a7b2e5-8af6-4534-86ff-712e132a95da tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:26.941287 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-78a7b2e5-8af6-4534-86ff-712e132a95da tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:26.941747 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-78a7b2e5-8af6-4534-86ff-712e132a95da tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:26.942535 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-78a7b2e5-8af6-4534-86ff-712e132a95da tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:26.942975 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-78a7b2e5-8af6-4534-86ff-712e132a95da tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:27.404313 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-fe86cd85-4c7b-4507-acd1-a807c27a4d2f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:27.417063 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-fe86cd85-4c7b-4507-acd1-a807c27a4d2f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:27.418823 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-fe86cd85-4c7b-4507-acd1-a807c27a4d2f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:27.421306 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-fe86cd85-4c7b-4507-acd1-a807c27a4d2f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.603212 Jun 27 09:36:27.427622 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 27/59] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:26 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:36:27.433902 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-8a3e5e80-ea6e-4f53-9335-2c04e0c6f379 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:27.438312 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-8a3e5e80-ea6e-4f53-9335-2c04e0c6f379 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:27.452406 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8a3e5e80-ea6e-4f53-9335-2c04e0c6f379 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:27.453387 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8a3e5e80-ea6e-4f53-9335-2c04e0c6f379 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:27.455648 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8a3e5e80-ea6e-4f53-9335-2c04e0c6f379 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:27.458723 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8a3e5e80-ea6e-4f53-9335-2c04e0c6f379 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:27.776604 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8a3e5e80-ea6e-4f53-9335-2c04e0c6f379 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:27.776604 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-8a3e5e80-ea6e-4f53-9335-2c04e0c6f379 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1280 microversion: 2.1 time: 0.244591 Jun 27 09:36:27.776604 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 28/60] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:27 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1280 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:27.776604 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-95458032-079c-459f-bcdd-979c6fd5a0a6 tempest-VolumesGetTestJSON-2056958609 tempest-VolumesGetTestJSON-2056958609-project] Calling method '.version_select at 0x7ffa9c0cd8b0>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:27.778447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-95458032-079c-459f-bcdd-979c6fd5a0a6 tempest-VolumesGetTestJSON-2056958609 tempest-VolumesGetTestJSON-2056958609-project] HTTP exception thrown: Volume 1d042fa9-191b-4bb0-a2be-b666a1b5ea55 could not be found. Jun 27 09:36:27.778447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-95458032-079c-459f-bcdd-979c6fd5a0a6 tempest-VolumesGetTestJSON-2056958609 tempest-VolumesGetTestJSON-2056958609-project] Request method failure captured: Jun 27 09:36:27.778447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: GET /compute/v2.1/os-volumes/1d042fa9-191b-4bb0-a2be-b666a1b5ea55 HTTP/1.1 Jun 27 09:36:27.778447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:36:27.778447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:36:27.778447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:36:27.778447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:36:27.778447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:36:27.778447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:36:27.778447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:36:27.778447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:36:27.778447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXoWbVfGRPrAAk8p5haB-jd14PgC6-r1mP7yS9qiYAhQuZdbNqmFTKGMkvxEETz2uJliHa9cVcCkbhDSL0cmNFMcCtK6qKoBcKRfdXa7st8y8LszW10KNMmehTx0-JR6o4BcUCva6JvwI_7NivqB68frjnglB1XNZnOdhoYMx0lDm-0 Jun 27 09:36:27.778447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:36:27.778447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:36:27.778447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:36:27.778447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:36:27.778447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:36:27.778447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:36:27.778447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: 81f0d69f219148e4a8b49c2465e25d08 Jun 27 09:36:27.778447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-VolumesGetTestJSON-2056958609 Jun 27 09:36:27.778447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:36:27.778447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:36:27.781440 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/81f0d69f219148e4a8b49c2465e25d08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/81f0d69f219148e4a8b49c2465e25d08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/81f0d69f219148e4a8b49c2465e25d08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_81f0d69f219148e4a8b49c2465e25d08", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:36:27.781440 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-VolumesGetTestJSON-2056958609 Jun 27 09:36:27.781440 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: 81f0d69f219148e4a8b49c2465e25d08 Jun 27 09:36:27.781440 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-VolumesGetTestJSON-2056958609 Jun 27 09:36:27.781440 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-VolumesGetTestJSON-2056958609-project Jun 27 09:36:27.781440 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:36:27.781440 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:36:27.781440 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: 43847e34424a4b2a8e9c0e4baa73b4e4 Jun 27 09:36:27.781440 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-VolumesGetTestJSON-2056958609-project Jun 27 09:36:27.781440 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: Jun 27 09:36:27.781440 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Volume 1d042fa9-191b-4bb0-a2be-b666a1b5ea55 could not be found. Jun 27 09:36:27.781440 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': '1d042fa9-191b-4bb0-a2be-b666a1b5ea55'} Jun 27 09:36:27.781440 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:36:27.783172 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:36:27.783172 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 09:36:27.783172 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 09:36:27.783172 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 09:36:27.783172 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 09:36:27.783172 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 09:36:27.783172 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 09:36:27.783172 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 09:36:27.783172 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 09:36:27.783172 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 09:36:27.783172 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 09:36:27.783172 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 09:36:27.783172 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 09:36:27.783172 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 09:36:27.783172 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 09:36:27.783172 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1d042fa9-191b-4bb0-a2be-b666a1b5ea55 could not be found. (HTTP 404) (Request-ID: req-f9349a89-8b35-4094-959c-c3c9860b3e1f) Jun 27 09:36:27.783172 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:36:27.783172 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:36:27.783172 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:36:27.784499 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:36:27.784499 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 09:36:27.784499 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 09:36:27.784499 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 09:36:27.784499 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 09:36:27.784499 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 09:36:27.784499 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 09:36:27.784499 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 09:36:27.784499 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 09:36:27.784499 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 09:36:27.784499 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 09:36:27.784499 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 09:36:27.784499 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 09:36:27.784499 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 09:36:27.784499 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 09:36:27.784499 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 09:36:27.784499 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 09:36:27.784499 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 09:36:27.784499 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 09:36:27.785770 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 09:36:27.785770 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 09:36:27.785770 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 09:36:27.785770 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 09:36:27.785770 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1d042fa9-191b-4bb0-a2be-b666a1b5ea55 could not be found. Jun 27 09:36:27.785770 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:36:27.785770 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:36:27.785770 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:36:27.785770 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:36:27.785770 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:36:27.785770 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:36:27.785770 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:36:27.785770 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:36:27.785770 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 09:36:27.785770 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 09:36:27.785770 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:36:27.785770 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:36:27.785770 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 09:36:27.785770 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:36:27.787037 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1d042fa9-191b-4bb0-a2be-b666a1b5ea55 could not be found. Jun 27 09:36:27.787037 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:36:27.787037 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:36:27.787037 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:36:27.787037 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:36:27.787037 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:36:27.787037 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:36:27.787037 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:36:27.787037 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:36:27.787037 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1d042fa9-191b-4bb0-a2be-b666a1b5ea55 could not be found. Jun 27 09:36:27.787037 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:36:27.787798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-78a7b2e5-8af6-4534-86ff-712e132a95da tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:27.788453 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-95458032-079c-459f-bcdd-979c6fd5a0a6 tempest-VolumesGetTestJSON-2056958609 tempest-VolumesGetTestJSON-2056958609-project] Returning 404 to user: Volume 1d042fa9-191b-4bb0-a2be-b666a1b5ea55 could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:36:27.788453 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-95458032-079c-459f-bcdd-979c6fd5a0a6 tempest-VolumesGetTestJSON-2056958609 tempest-VolumesGetTestJSON-2056958609-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/1d042fa9-191b-4bb0-a2be-b666a1b5ea55" status: 404 len: 109 microversion: 2.1 time: 0.044424 Jun 27 09:36:27.788453 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 29/61] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 27 09:36:27 2022] GET /compute/v2.1/os-volumes/1d042fa9-191b-4bb0-a2be-b666a1b5ea55 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:36:27.789100 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-78a7b2e5-8af6-4534-86ff-712e132a95da tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1315 microversion: 2.1 time: 0.802813 Jun 27 09:36:27.789100 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 33/62] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:26 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1315 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:28.452831 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-54311397-4854-4999-907f-12ca95c5df20 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:28.454148 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-54311397-4854-4999-907f-12ca95c5df20 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:28.470567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-54311397-4854-4999-907f-12ca95c5df20 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:28.470567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-54311397-4854-4999-907f-12ca95c5df20 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:28.470567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-54311397-4854-4999-907f-12ca95c5df20 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:28.470921 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-54311397-4854-4999-907f-12ca95c5df20 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:28.691814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-54311397-4854-4999-907f-12ca95c5df20 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:28.701059 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-54311397-4854-4999-907f-12ca95c5df20 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:28.702777 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-54311397-4854-4999-907f-12ca95c5df20 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:28.703984 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-54311397-4854-4999-907f-12ca95c5df20 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.258883 Jun 27 09:36:28.705184 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 30/63] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:28 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:36:28.782618 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-64e9e20a-b677-4579-b84b-195bcabee0a7 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:28.783315 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-64e9e20a-b677-4579-b84b-195bcabee0a7 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:28.785389 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-820960ae-fef0-4f3c-95bc-f7f6095fff70 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:28.786472 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-820960ae-fef0-4f3c-95bc-f7f6095fff70 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:28.813604 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-64e9e20a-b677-4579-b84b-195bcabee0a7 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:28.813604 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-64e9e20a-b677-4579-b84b-195bcabee0a7 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:28.813604 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-64e9e20a-b677-4579-b84b-195bcabee0a7 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:28.813604 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-64e9e20a-b677-4579-b84b-195bcabee0a7 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:28.818805 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-820960ae-fef0-4f3c-95bc-f7f6095fff70 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:28.821182 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-820960ae-fef0-4f3c-95bc-f7f6095fff70 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:28.822245 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-820960ae-fef0-4f3c-95bc-f7f6095fff70 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:28.823119 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-820960ae-fef0-4f3c-95bc-f7f6095fff70 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:29.093055 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-820960ae-fef0-4f3c-95bc-f7f6095fff70 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:29.101719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-820960ae-fef0-4f3c-95bc-f7f6095fff70 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1315 microversion: 2.1 time: 0.327051 Jun 27 09:36:29.112927 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 31/64] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:28 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:29.143867 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-64e9e20a-b677-4579-b84b-195bcabee0a7 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:29.152047 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-64e9e20a-b677-4579-b84b-195bcabee0a7 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.375521 Jun 27 09:36:29.154830 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 34/65] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:28 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:29.724927 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-ed608bdc-3dbd-45f3-92da-82e56811a4b4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:29.726363 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-ed608bdc-3dbd-45f3-92da-82e56811a4b4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:29.741484 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ed608bdc-3dbd-45f3-92da-82e56811a4b4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:29.743826 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ed608bdc-3dbd-45f3-92da-82e56811a4b4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:29.745391 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ed608bdc-3dbd-45f3-92da-82e56811a4b4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:29.758779 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ed608bdc-3dbd-45f3-92da-82e56811a4b4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:30.122238 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-a98bd816-f366-4df9-9787-71298658df99 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:30.123425 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-a98bd816-f366-4df9-9787-71298658df99 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:30.143833 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a98bd816-f366-4df9-9787-71298658df99 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:30.147175 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a98bd816-f366-4df9-9787-71298658df99 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:30.149309 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a98bd816-f366-4df9-9787-71298658df99 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:30.151413 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a98bd816-f366-4df9-9787-71298658df99 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:30.226662 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=4 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:30.716062 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-ed608bdc-3dbd-45f3-92da-82e56811a4b4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:30.734881 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-ed608bdc-3dbd-45f3-92da-82e56811a4b4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:30.737377 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-ed608bdc-3dbd-45f3-92da-82e56811a4b4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:30.738866 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-ed608bdc-3dbd-45f3-92da-82e56811a4b4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 1.019103 Jun 27 09:36:30.739761 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 32/66] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:29 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:36:30.748204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-5afc2af2-ebc5-4024-a89a-028733315eec tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:30.750346 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-5afc2af2-ebc5-4024-a89a-028733315eec tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:30.767366 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5afc2af2-ebc5-4024-a89a-028733315eec tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:30.768012 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5afc2af2-ebc5-4024-a89a-028733315eec tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:30.768872 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5afc2af2-ebc5-4024-a89a-028733315eec tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:30.769322 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5afc2af2-ebc5-4024-a89a-028733315eec tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:30.817373 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-a98bd816-f366-4df9-9787-71298658df99 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:30.827879 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell0:SELECT=4 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:30.831834 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-a98bd816-f366-4df9-9787-71298658df99 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1315 microversion: 2.1 time: 0.715619 Jun 27 09:36:30.847288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 35/67] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:30 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1315 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:36:31.234954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=22 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:31.422672 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-5afc2af2-ebc5-4024-a89a-028733315eec tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:31.436261 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-5afc2af2-ebc5-4024-a89a-028733315eec tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.692398 Jun 27 09:36:31.448646 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 33/68] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:30 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:31.760389 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-face5dfb-9a05-4723-a258-3ef554bc8209 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:31.761047 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-face5dfb-9a05-4723-a258-3ef554bc8209 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:31.789770 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-face5dfb-9a05-4723-a258-3ef554bc8209 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:31.791059 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-face5dfb-9a05-4723-a258-3ef554bc8209 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:31.792128 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-face5dfb-9a05-4723-a258-3ef554bc8209 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:31.794465 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-face5dfb-9a05-4723-a258-3ef554bc8209 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:31.857209 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-2cc5758f-1ec8-4006-89d6-6313c8f1961a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:31.858011 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-2cc5758f-1ec8-4006-89d6-6313c8f1961a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:31.870414 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2cc5758f-1ec8-4006-89d6-6313c8f1961a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:31.870862 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2cc5758f-1ec8-4006-89d6-6313c8f1961a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:31.873597 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2cc5758f-1ec8-4006-89d6-6313c8f1961a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:31.874080 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2cc5758f-1ec8-4006-89d6-6313c8f1961a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:32.444894 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell0:SELECT=20 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:32.908957 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-2cc5758f-1ec8-4006-89d6-6313c8f1961a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:32.922632 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-2cc5758f-1ec8-4006-89d6-6313c8f1961a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1315 microversion: 2.1 time: 1.071964 Jun 27 09:36:32.923222 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 34/69] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:31 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1315 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:32.940878 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-2c27d77a-5d11-41b1-b382-0b6d9dfe003f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:32.941737 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-2c27d77a-5d11-41b1-b382-0b6d9dfe003f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:32.950218 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2c27d77a-5d11-41b1-b382-0b6d9dfe003f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:32.950871 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2c27d77a-5d11-41b1-b382-0b6d9dfe003f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:32.951958 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2c27d77a-5d11-41b1-b382-0b6d9dfe003f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:32.952546 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2c27d77a-5d11-41b1-b382-0b6d9dfe003f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:33.105454 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-face5dfb-9a05-4723-a258-3ef554bc8209 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:33.124402 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-face5dfb-9a05-4723-a258-3ef554bc8209 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:33.126644 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-face5dfb-9a05-4723-a258-3ef554bc8209 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:33.131953 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-face5dfb-9a05-4723-a258-3ef554bc8209 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 1.378017 Jun 27 09:36:33.133247 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 36/70] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:31 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:36:33.312641 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-2c27d77a-5d11-41b1-b382-0b6d9dfe003f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:33.337677 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-2c27d77a-5d11-41b1-b382-0b6d9dfe003f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.402831 Jun 27 09:36:33.337677 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 35/71] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:32 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:33.564492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-ff9bb129-b3a2-4a89-89c3-46d57d37a51e req-f7ae0cc5-1124-49c7-a952-76f97840c06a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d72055f-6915-43b5-9831-61c2f134e60a", "tag": "a233eb88-dce4-49a8-9bf9-7a59a86e981b"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:36:33.607484 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-ff9bb129-b3a2-4a89-89c3-46d57d37a51e req-f7ae0cc5-1124-49c7-a952-76f97840c06a service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:33.621123 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-ff9bb129-b3a2-4a89-89c3-46d57d37a51e req-f7ae0cc5-1124-49c7-a952-76f97840c06a service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:33.722984 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-ff9bb129-b3a2-4a89-89c3-46d57d37a51e req-f7ae0cc5-1124-49c7-a952-76f97840c06a service nova] Creating event network-changed:a233eb88-dce4-49a8-9bf9-7a59a86e981b for instance 1d72055f-6915-43b5-9831-61c2f134e60a on hv-cinder-84773 Jun 27 09:36:33.724106 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-ff9bb129-b3a2-4a89-89c3-46d57d37a51e req-f7ae0cc5-1124-49c7-a952-76f97840c06a service nova] Acquired lock "compute-rpcapi-router" {{(pid=124869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 27 09:36:33.728564 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-13947b28-0d64-48ff-a6f9-4f9f16cf803a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:33.731740 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-13947b28-0d64-48ff-a6f9-4f9f16cf803a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:33.736644 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-13947b28-0d64-48ff-a6f9-4f9f16cf803a None None] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:33.737914 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-13947b28-0d64-48ff-a6f9-4f9f16cf803a None None] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:33.789461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.compute.rpcapi [None req-13947b28-0d64-48ff-a6f9-4f9f16cf803a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 27 09:36:33.796351 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-13947b28-0d64-48ff-a6f9-4f9f16cf803a None None] Releasing lock "compute-rpcapi-router" {{(pid=124869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 27 09:36:33.835153 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-13947b28-0d64-48ff-a6f9-4f9f16cf803a None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.699804 Jun 27 09:36:33.837764 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 37/72] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:36:33.942828 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-dc17b260-10d7-47ff-b579-555963a96fbc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:33.942828 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-dc17b260-10d7-47ff-b579-555963a96fbc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:33.952146 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dc17b260-10d7-47ff-b579-555963a96fbc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:33.952596 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dc17b260-10d7-47ff-b579-555963a96fbc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:33.953825 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dc17b260-10d7-47ff-b579-555963a96fbc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:33.954459 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dc17b260-10d7-47ff-b579-555963a96fbc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:34.168859 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-71d48c8b-f083-49c7-8e5e-fb119876da7b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:34.170312 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-71d48c8b-f083-49c7-8e5e-fb119876da7b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:34.190780 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-71d48c8b-f083-49c7-8e5e-fb119876da7b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:34.191285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-71d48c8b-f083-49c7-8e5e-fb119876da7b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:34.192358 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-71d48c8b-f083-49c7-8e5e-fb119876da7b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:34.193276 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-71d48c8b-f083-49c7-8e5e-fb119876da7b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:34.245907 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-dc17b260-10d7-47ff-b579-555963a96fbc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:34.254523 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-dc17b260-10d7-47ff-b579-555963a96fbc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1315 microversion: 2.1 time: 0.318431 Jun 27 09:36:34.256294 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 36/73] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:33 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:34.449588 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-14ecde9b-dac3-46a5-bef6-4d2ec2dbc38c req-51762e84-c6bf-43bd-91f5-160f97f31950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5540f679-ef89-453b-91c5-b11dacd977bd", "tag": "32d1fb71-3a28-4a00-b9f4-b8c218fba63d"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:36:34.477315 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-14ecde9b-dac3-46a5-bef6-4d2ec2dbc38c req-51762e84-c6bf-43bd-91f5-160f97f31950 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:34.477759 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-14ecde9b-dac3-46a5-bef6-4d2ec2dbc38c req-51762e84-c6bf-43bd-91f5-160f97f31950 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:34.501420 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-14ecde9b-dac3-46a5-bef6-4d2ec2dbc38c req-51762e84-c6bf-43bd-91f5-160f97f31950 service nova] Creating event network-changed:32d1fb71-3a28-4a00-b9f4-b8c218fba63d for instance 5540f679-ef89-453b-91c5-b11dacd977bd on hv-cinder-84773 Jun 27 09:36:34.502413 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-14ecde9b-dac3-46a5-bef6-4d2ec2dbc38c req-51762e84-c6bf-43bd-91f5-160f97f31950 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 27 09:36:34.503964 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-af689b18-3f97-49d2-b037-cc90f46e5eaf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:34.504537 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-af689b18-3f97-49d2-b037-cc90f46e5eaf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:34.505584 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-af689b18-3f97-49d2-b037-cc90f46e5eaf None None] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:34.506082 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-af689b18-3f97-49d2-b037-cc90f46e5eaf None None] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:34.514548 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-71d48c8b-f083-49c7-8e5e-fb119876da7b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:34.518838 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.compute.rpcapi [None req-af689b18-3f97-49d2-b037-cc90f46e5eaf None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 27 09:36:34.519941 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-af689b18-3f97-49d2-b037-cc90f46e5eaf None None] Releasing lock "compute-rpcapi-router" {{(pid=124870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 27 09:36:34.526875 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-71d48c8b-f083-49c7-8e5e-fb119876da7b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:34.546667 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-af689b18-3f97-49d2-b037-cc90f46e5eaf None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.287757 Jun 27 09:36:34.547208 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-71d48c8b-f083-49c7-8e5e-fb119876da7b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:34.548526 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 37/74] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:36:34.550835 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-71d48c8b-f083-49c7-8e5e-fb119876da7b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.399280 Jun 27 09:36:34.551708 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 38/75] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:34 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:36:34.556465 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-cae61c2f-98df-4ff2-8a8d-dd806ae5ae09 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:34.557168 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-cae61c2f-98df-4ff2-8a8d-dd806ae5ae09 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:34.563703 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cae61c2f-98df-4ff2-8a8d-dd806ae5ae09 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:34.564161 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cae61c2f-98df-4ff2-8a8d-dd806ae5ae09 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:34.564937 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cae61c2f-98df-4ff2-8a8d-dd806ae5ae09 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:34.565372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cae61c2f-98df-4ff2-8a8d-dd806ae5ae09 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:34.758423 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-cae61c2f-98df-4ff2-8a8d-dd806ae5ae09 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:34.760851 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-cae61c2f-98df-4ff2-8a8d-dd806ae5ae09 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.209657 Jun 27 09:36:34.761458 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 38/76] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:34 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:35.271358 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-635d597e-0d81-49e3-a09e-d8e9266b03bf tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:35.272181 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-635d597e-0d81-49e3-a09e-d8e9266b03bf tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:35.278465 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-635d597e-0d81-49e3-a09e-d8e9266b03bf tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:35.278943 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-635d597e-0d81-49e3-a09e-d8e9266b03bf tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:35.279745 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-635d597e-0d81-49e3-a09e-d8e9266b03bf tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:35.280188 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-635d597e-0d81-49e3-a09e-d8e9266b03bf tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:35.433438 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-635d597e-0d81-49e3-a09e-d8e9266b03bf tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:35.442541 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-635d597e-0d81-49e3-a09e-d8e9266b03bf tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1315 microversion: 2.1 time: 0.174941 Jun 27 09:36:35.444265 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 39/77] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:35 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:35.568687 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-173b9716-b072-4d97-bf6d-d4d03aabc5be tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:35.569968 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-173b9716-b072-4d97-bf6d-d4d03aabc5be tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:35.572073 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:35.588059 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-173b9716-b072-4d97-bf6d-d4d03aabc5be tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:35.588588 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-173b9716-b072-4d97-bf6d-d4d03aabc5be tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:35.596901 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-173b9716-b072-4d97-bf6d-d4d03aabc5be tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:35.596901 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-173b9716-b072-4d97-bf6d-d4d03aabc5be tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:35.750313 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-173b9716-b072-4d97-bf6d-d4d03aabc5be tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:35.759181 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-173b9716-b072-4d97-bf6d-d4d03aabc5be tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:35.760729 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-173b9716-b072-4d97-bf6d-d4d03aabc5be tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:35.762041 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-173b9716-b072-4d97-bf6d-d4d03aabc5be tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.197224 Jun 27 09:36:35.763029 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 39/78] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:35 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:36:35.778480 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-192d648e-c7a8-4715-b061-52a52926e921 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:35.779085 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-192d648e-c7a8-4715-b061-52a52926e921 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:35.785207 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-192d648e-c7a8-4715-b061-52a52926e921 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:35.785824 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-192d648e-c7a8-4715-b061-52a52926e921 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:35.786834 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-192d648e-c7a8-4715-b061-52a52926e921 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:35.787418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-192d648e-c7a8-4715-b061-52a52926e921 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:35.885835 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-606b0bed-f046-4e77-a490-3b9d0ebc30c2 req-1c80c6ad-9f09-40a8-afc7-788c0248bd33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9", "tag": "cb15c03b-d1f2-488e-baae-86a39cab937b"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:36:35.895915 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-606b0bed-f046-4e77-a490-3b9d0ebc30c2 req-1c80c6ad-9f09-40a8-afc7-788c0248bd33 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:35.896364 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-606b0bed-f046-4e77-a490-3b9d0ebc30c2 req-1c80c6ad-9f09-40a8-afc7-788c0248bd33 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:35.909678 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-606b0bed-f046-4e77-a490-3b9d0ebc30c2 req-1c80c6ad-9f09-40a8-afc7-788c0248bd33 service nova] Creating event network-changed:cb15c03b-d1f2-488e-baae-86a39cab937b for instance 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 on hv-cinder-84773 Jun 27 09:36:35.915762 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-606b0bed-f046-4e77-a490-3b9d0ebc30c2 req-1c80c6ad-9f09-40a8-afc7-788c0248bd33 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034554 Jun 27 09:36:35.916840 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 40/79] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:36:35.932537 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-192d648e-c7a8-4715-b061-52a52926e921 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:35.940671 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-192d648e-c7a8-4715-b061-52a52926e921 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.165843 Jun 27 09:36:35.941654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 40/80] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:35 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:36.461678 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-8fb67137-4233-4e90-a3ae-cb01c3bae29a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:36.462753 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-8fb67137-4233-4e90-a3ae-cb01c3bae29a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:36.475374 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8fb67137-4233-4e90-a3ae-cb01c3bae29a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:36.475374 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8fb67137-4233-4e90-a3ae-cb01c3bae29a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:36.476895 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8fb67137-4233-4e90-a3ae-cb01c3bae29a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:36.477674 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8fb67137-4233-4e90-a3ae-cb01c3bae29a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:36.578625 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-d16459c2-9d1a-435f-bc41-a8532bcb8d25 req-4ef63ef7-fcf8-45e8-b821-77e62aa9c7dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7744db71-f29c-4221-af51-e3688c4fbc97", "tag": "9720d11f-73fc-4566-a281-54fa01d4bc65"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:36:36.588231 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-d16459c2-9d1a-435f-bc41-a8532bcb8d25 req-4ef63ef7-fcf8-45e8-b821-77e62aa9c7dd service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:36.589070 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-d16459c2-9d1a-435f-bc41-a8532bcb8d25 req-4ef63ef7-fcf8-45e8-b821-77e62aa9c7dd service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:36.594037 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=100 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:36.602136 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-d16459c2-9d1a-435f-bc41-a8532bcb8d25 req-4ef63ef7-fcf8-45e8-b821-77e62aa9c7dd service nova] Creating event network-changed:9720d11f-73fc-4566-a281-54fa01d4bc65 for instance 7744db71-f29c-4221-af51-e3688c4fbc97 on hv-cinder-84773 Jun 27 09:36:36.608271 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-d16459c2-9d1a-435f-bc41-a8532bcb8d25 req-4ef63ef7-fcf8-45e8-b821-77e62aa9c7dd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033863 Jun 27 09:36:36.609371 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 41/81] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:36:36.786034 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f87a94cc-a6ce-4b3c-abf1-8f6ea78e82e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:36.789234 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-f87a94cc-a6ce-4b3c-abf1-8f6ea78e82e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:36.810125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f87a94cc-a6ce-4b3c-abf1-8f6ea78e82e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:36.813076 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f87a94cc-a6ce-4b3c-abf1-8f6ea78e82e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:36.814928 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f87a94cc-a6ce-4b3c-abf1-8f6ea78e82e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:36.822078 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8fb67137-4233-4e90-a3ae-cb01c3bae29a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:36.832848 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f87a94cc-a6ce-4b3c-abf1-8f6ea78e82e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:36.845795 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-8fb67137-4233-4e90-a3ae-cb01c3bae29a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1315 microversion: 2.1 time: 0.389014 Jun 27 09:36:36.850894 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 41/82] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:36 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:36.963629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-02ebce66-c22c-452f-8bf2-badac2a9c2c2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:36.964619 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-02ebce66-c22c-452f-8bf2-badac2a9c2c2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:36.988443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-02ebce66-c22c-452f-8bf2-badac2a9c2c2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:36.996270 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-02ebce66-c22c-452f-8bf2-badac2a9c2c2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:37.001538 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-02ebce66-c22c-452f-8bf2-badac2a9c2c2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:37.004187 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-02ebce66-c22c-452f-8bf2-badac2a9c2c2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:37.335396 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f87a94cc-a6ce-4b3c-abf1-8f6ea78e82e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:37.348680 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f87a94cc-a6ce-4b3c-abf1-8f6ea78e82e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:37.350193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f87a94cc-a6ce-4b3c-abf1-8f6ea78e82e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:37.351299 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-f87a94cc-a6ce-4b3c-abf1-8f6ea78e82e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.574032 Jun 27 09:36:37.351916 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 42/83] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:36 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:36:37.863822 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-17cbcbd4-62aa-4c72-b161-7f7eaa60c0e6 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:37.865208 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-17cbcbd4-62aa-4c72-b161-7f7eaa60c0e6 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:37.879666 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-17cbcbd4-62aa-4c72-b161-7f7eaa60c0e6 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:37.882107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-17cbcbd4-62aa-4c72-b161-7f7eaa60c0e6 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:37.885423 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-17cbcbd4-62aa-4c72-b161-7f7eaa60c0e6 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:37.888654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-17cbcbd4-62aa-4c72-b161-7f7eaa60c0e6 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:37.979798 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-02ebce66-c22c-452f-8bf2-badac2a9c2c2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:37.987206 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=100 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:37.993692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-02ebce66-c22c-452f-8bf2-badac2a9c2c2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 1.035942 Jun 27 09:36:37.997624 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 42/84] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:36 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:36:38.356051 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-17cbcbd4-62aa-4c72-b161-7f7eaa60c0e6 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:38.369162 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-17cbcbd4-62aa-4c72-b161-7f7eaa60c0e6 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1315 microversion: 2.1 time: 0.508499 Jun 27 09:36:38.370357 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-8a405fb9-a301-4771-97c9-bfa9e9d073fc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:38.371021 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-8a405fb9-a301-4771-97c9-bfa9e9d073fc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:38.373477 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 43/85] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:37 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1315 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:36:38.379595 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8a405fb9-a301-4771-97c9-bfa9e9d073fc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:38.380332 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8a405fb9-a301-4771-97c9-bfa9e9d073fc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:38.381384 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8a405fb9-a301-4771-97c9-bfa9e9d073fc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:38.382030 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8a405fb9-a301-4771-97c9-bfa9e9d073fc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:38.838796 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8a405fb9-a301-4771-97c9-bfa9e9d073fc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:38.860143 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8a405fb9-a301-4771-97c9-bfa9e9d073fc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:38.860143 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8a405fb9-a301-4771-97c9-bfa9e9d073fc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:38.861181 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-8a405fb9-a301-4771-97c9-bfa9e9d073fc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.495795 Jun 27 09:36:38.861770 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 43/86] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:38 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:36:39.015777 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-fe0c0d91-1787-4995-b119-dc05b88a2081 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:39.016469 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-fe0c0d91-1787-4995-b119-dc05b88a2081 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:39.028308 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fe0c0d91-1787-4995-b119-dc05b88a2081 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:39.028833 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fe0c0d91-1787-4995-b119-dc05b88a2081 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:39.038124 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fe0c0d91-1787-4995-b119-dc05b88a2081 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:39.038124 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fe0c0d91-1787-4995-b119-dc05b88a2081 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:39.389802 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-ab8c7c2c-8e2c-4178-9970-b703327ba17f tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:39.390427 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-ab8c7c2c-8e2c-4178-9970-b703327ba17f tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:39.402405 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ab8c7c2c-8e2c-4178-9970-b703327ba17f tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:39.402946 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ab8c7c2c-8e2c-4178-9970-b703327ba17f tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:39.403762 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ab8c7c2c-8e2c-4178-9970-b703327ba17f tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:39.404205 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ab8c7c2c-8e2c-4178-9970-b703327ba17f tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:39.679463 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-ab8c7c2c-8e2c-4178-9970-b703327ba17f tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:39.688850 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-ab8c7c2c-8e2c-4178-9970-b703327ba17f tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1315 microversion: 2.1 time: 0.302221 Jun 27 09:36:39.694520 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 44/87] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:39 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:39.776425 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-fe0c0d91-1787-4995-b119-dc05b88a2081 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:39.813043 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-fe0c0d91-1787-4995-b119-dc05b88a2081 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.792396 Jun 27 09:36:39.823368 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 44/88] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:39 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:39.880596 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-8224e617-fa0d-4c50-bc31-a2673470cd92 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:39.882542 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-8224e617-fa0d-4c50-bc31-a2673470cd92 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:39.894994 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8224e617-fa0d-4c50-bc31-a2673470cd92 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:39.900156 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8224e617-fa0d-4c50-bc31-a2673470cd92 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:39.901231 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8224e617-fa0d-4c50-bc31-a2673470cd92 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:39.901677 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8224e617-fa0d-4c50-bc31-a2673470cd92 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:40.312809 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8224e617-fa0d-4c50-bc31-a2673470cd92 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:40.326709 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8224e617-fa0d-4c50-bc31-a2673470cd92 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:40.328415 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8224e617-fa0d-4c50-bc31-a2673470cd92 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:40.330027 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-8224e617-fa0d-4c50-bc31-a2673470cd92 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.454718 Jun 27 09:36:40.336731 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 45/89] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:39 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:36:40.715702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-21c4f7cd-c7d2-4f65-9da7-2c747a4561b4 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:40.716312 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-21c4f7cd-c7d2-4f65-9da7-2c747a4561b4 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:40.719897 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:40.724688 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-21c4f7cd-c7d2-4f65-9da7-2c747a4561b4 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:40.725653 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-21c4f7cd-c7d2-4f65-9da7-2c747a4561b4 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:40.726580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-21c4f7cd-c7d2-4f65-9da7-2c747a4561b4 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:40.727010 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-21c4f7cd-c7d2-4f65-9da7-2c747a4561b4 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:40.830147 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a69945fc-7edc-43e8-b09f-22033854d11a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:40.830849 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-a69945fc-7edc-43e8-b09f-22033854d11a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:40.839100 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a69945fc-7edc-43e8-b09f-22033854d11a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:40.839571 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a69945fc-7edc-43e8-b09f-22033854d11a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:40.840352 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a69945fc-7edc-43e8-b09f-22033854d11a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:40.840780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a69945fc-7edc-43e8-b09f-22033854d11a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:41.067521 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a69945fc-7edc-43e8-b09f-22033854d11a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:41.081666 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-a69945fc-7edc-43e8-b09f-22033854d11a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.255077 Jun 27 09:36:41.082356 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 46/90] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:40 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:36:41.154565 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-21c4f7cd-c7d2-4f65-9da7-2c747a4561b4 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:41.169345 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-21c4f7cd-c7d2-4f65-9da7-2c747a4561b4 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1315 microversion: 2.1 time: 0.461499 Jun 27 09:36:41.169941 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 45/91] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:40 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:41.349123 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-8107f94c-9d38-41cc-91bb-a9e09e12a4f7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:41.349777 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-8107f94c-9d38-41cc-91bb-a9e09e12a4f7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:41.362045 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8107f94c-9d38-41cc-91bb-a9e09e12a4f7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:41.362615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8107f94c-9d38-41cc-91bb-a9e09e12a4f7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:41.364902 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8107f94c-9d38-41cc-91bb-a9e09e12a4f7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:41.365416 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8107f94c-9d38-41cc-91bb-a9e09e12a4f7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:41.594408 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8107f94c-9d38-41cc-91bb-a9e09e12a4f7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:41.602622 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8107f94c-9d38-41cc-91bb-a9e09e12a4f7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:41.604203 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8107f94c-9d38-41cc-91bb-a9e09e12a4f7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:41.605296 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-8107f94c-9d38-41cc-91bb-a9e09e12a4f7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.260574 Jun 27 09:36:41.605855 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 47/92] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:41 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:36:42.098945 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-80a007e6-56a7-4c59-844f-0909835deb91 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:42.099565 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-80a007e6-56a7-4c59-844f-0909835deb91 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:42.106699 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-80a007e6-56a7-4c59-844f-0909835deb91 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:42.107150 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-80a007e6-56a7-4c59-844f-0909835deb91 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:42.107979 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-80a007e6-56a7-4c59-844f-0909835deb91 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:42.111433 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-80a007e6-56a7-4c59-844f-0909835deb91 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:42.189400 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c2bcc733-ea4a-44a2-a0e3-1f472de20bc0 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:42.190009 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-c2bcc733-ea4a-44a2-a0e3-1f472de20bc0 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:42.202469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c2bcc733-ea4a-44a2-a0e3-1f472de20bc0 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:42.203352 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c2bcc733-ea4a-44a2-a0e3-1f472de20bc0 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:42.206511 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c2bcc733-ea4a-44a2-a0e3-1f472de20bc0 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:42.208238 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c2bcc733-ea4a-44a2-a0e3-1f472de20bc0 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:42.315062 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-80a007e6-56a7-4c59-844f-0909835deb91 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:42.324505 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-80a007e6-56a7-4c59-844f-0909835deb91 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.229838 Jun 27 09:36:42.335252 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 46/93] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:42 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:42.387923 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-c2bcc733-ea4a-44a2-a0e3-1f472de20bc0 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:42.395490 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-c2bcc733-ea4a-44a2-a0e3-1f472de20bc0 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1315 microversion: 2.1 time: 0.209718 Jun 27 09:36:42.396080 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 48/94] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:42 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:42.624153 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-dfca4aae-2a2a-4c40-8b6f-ec4a14cf05a6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:42.624690 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-dfca4aae-2a2a-4c40-8b6f-ec4a14cf05a6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:42.631826 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dfca4aae-2a2a-4c40-8b6f-ec4a14cf05a6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:42.632856 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dfca4aae-2a2a-4c40-8b6f-ec4a14cf05a6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:42.633616 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dfca4aae-2a2a-4c40-8b6f-ec4a14cf05a6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:42.634045 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dfca4aae-2a2a-4c40-8b6f-ec4a14cf05a6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:42.775918 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-dfca4aae-2a2a-4c40-8b6f-ec4a14cf05a6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:42.781408 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-dfca4aae-2a2a-4c40-8b6f-ec4a14cf05a6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:42.782933 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-dfca4aae-2a2a-4c40-8b6f-ec4a14cf05a6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:42.784128 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-dfca4aae-2a2a-4c40-8b6f-ec4a14cf05a6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.163854 Jun 27 09:36:42.784712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 47/95] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:42 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:36:43.341695 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-679d025e-7b28-4607-96ea-f4295f3d88c2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:43.342496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-679d025e-7b28-4607-96ea-f4295f3d88c2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:43.348935 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-679d025e-7b28-4607-96ea-f4295f3d88c2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:43.349479 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-679d025e-7b28-4607-96ea-f4295f3d88c2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:43.350868 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-679d025e-7b28-4607-96ea-f4295f3d88c2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:43.351369 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-679d025e-7b28-4607-96ea-f4295f3d88c2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:43.414129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f6098113-cb3d-43f2-bb0e-d768389207a9 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:43.414879 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-f6098113-cb3d-43f2-bb0e-d768389207a9 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:43.421413 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f6098113-cb3d-43f2-bb0e-d768389207a9 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:43.426004 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f6098113-cb3d-43f2-bb0e-d768389207a9 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:43.427428 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f6098113-cb3d-43f2-bb0e-d768389207a9 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:43.446381 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f6098113-cb3d-43f2-bb0e-d768389207a9 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:43.559583 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-679d025e-7b28-4607-96ea-f4295f3d88c2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:43.567623 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-679d025e-7b28-4607-96ea-f4295f3d88c2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.229799 Jun 27 09:36:43.568204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 49/96] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:43 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:43.629781 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f6098113-cb3d-43f2-bb0e-d768389207a9 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:43.642004 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-f6098113-cb3d-43f2-bb0e-d768389207a9 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1315 microversion: 2.1 time: 0.233014 Jun 27 09:36:43.642582 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 48/97] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:43 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:43.803064 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-f5eb2eb8-90e3-47a3-8d31-2f18c036438c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:43.804044 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-f5eb2eb8-90e3-47a3-8d31-2f18c036438c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:43.811264 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f5eb2eb8-90e3-47a3-8d31-2f18c036438c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:43.812008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f5eb2eb8-90e3-47a3-8d31-2f18c036438c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:43.813080 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f5eb2eb8-90e3-47a3-8d31-2f18c036438c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:43.813696 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f5eb2eb8-90e3-47a3-8d31-2f18c036438c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:43.952114 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-f5eb2eb8-90e3-47a3-8d31-2f18c036438c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:43.960064 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-f5eb2eb8-90e3-47a3-8d31-2f18c036438c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:43.961555 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-f5eb2eb8-90e3-47a3-8d31-2f18c036438c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:43.962651 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-f5eb2eb8-90e3-47a3-8d31-2f18c036438c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.163618 Jun 27 09:36:43.965282 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 50/98] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:43 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:36:44.585292 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-24d2c4ee-d8e4-4681-b688-528aa1810fd9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:44.586006 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-24d2c4ee-d8e4-4681-b688-528aa1810fd9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:44.587779 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell0:SELECT=2 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:44.593854 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-24d2c4ee-d8e4-4681-b688-528aa1810fd9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:44.594304 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-24d2c4ee-d8e4-4681-b688-528aa1810fd9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:44.595073 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-24d2c4ee-d8e4-4681-b688-528aa1810fd9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:44.595507 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-24d2c4ee-d8e4-4681-b688-528aa1810fd9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:44.659574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-5c8bf6f7-174a-441c-b9c8-f83b32691dd7 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:44.660044 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-5c8bf6f7-174a-441c-b9c8-f83b32691dd7 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:44.670344 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=2 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:44.684280 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5c8bf6f7-174a-441c-b9c8-f83b32691dd7 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:44.685149 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5c8bf6f7-174a-441c-b9c8-f83b32691dd7 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:44.686202 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5c8bf6f7-174a-441c-b9c8-f83b32691dd7 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:44.687093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5c8bf6f7-174a-441c-b9c8-f83b32691dd7 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:44.793695 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-24d2c4ee-d8e4-4681-b688-528aa1810fd9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:44.801150 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-24d2c4ee-d8e4-4681-b688-528aa1810fd9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.220322 Jun 27 09:36:44.801711 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 49/99] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:44 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:44.860443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-5c8bf6f7-174a-441c-b9c8-f83b32691dd7 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:44.872755 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-5c8bf6f7-174a-441c-b9c8-f83b32691dd7 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1315 microversion: 2.1 time: 0.216326 Jun 27 09:36:44.874380 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 51/100] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:44 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:44.981887 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-96ae9af0-16db-4cec-8ce0-db54b8d386f4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:44.982559 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-96ae9af0-16db-4cec-8ce0-db54b8d386f4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:44.988842 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-96ae9af0-16db-4cec-8ce0-db54b8d386f4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:44.989647 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-96ae9af0-16db-4cec-8ce0-db54b8d386f4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:44.990768 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-96ae9af0-16db-4cec-8ce0-db54b8d386f4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:44.991504 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-96ae9af0-16db-4cec-8ce0-db54b8d386f4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:45.163683 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-96ae9af0-16db-4cec-8ce0-db54b8d386f4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:45.180556 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-96ae9af0-16db-4cec-8ce0-db54b8d386f4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:45.180556 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-96ae9af0-16db-4cec-8ce0-db54b8d386f4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:45.180556 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-96ae9af0-16db-4cec-8ce0-db54b8d386f4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.202791 Jun 27 09:36:45.181044 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 50/101] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:44 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:36:45.818213 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-b6673e5f-25c4-4093-87da-5cfc9c8c6806 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:45.820329 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-b6673e5f-25c4-4093-87da-5cfc9c8c6806 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:45.832540 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b6673e5f-25c4-4093-87da-5cfc9c8c6806 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:45.833032 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b6673e5f-25c4-4093-87da-5cfc9c8c6806 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:45.833989 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b6673e5f-25c4-4093-87da-5cfc9c8c6806 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:45.835029 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b6673e5f-25c4-4093-87da-5cfc9c8c6806 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:45.891099 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-dd855ef7-e1ab-45f6-91a5-998a6e9bfbfc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:45.893217 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-dd855ef7-e1ab-45f6-91a5-998a6e9bfbfc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:45.901332 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dd855ef7-e1ab-45f6-91a5-998a6e9bfbfc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:45.901888 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dd855ef7-e1ab-45f6-91a5-998a6e9bfbfc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:45.902724 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dd855ef7-e1ab-45f6-91a5-998a6e9bfbfc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:45.903260 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dd855ef7-e1ab-45f6-91a5-998a6e9bfbfc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:45.998208 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-b6673e5f-25c4-4093-87da-5cfc9c8c6806 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:46.005892 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-b6673e5f-25c4-4093-87da-5cfc9c8c6806 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.192186 Jun 27 09:36:46.007169 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 52/102] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:45 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:46.043775 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-dd855ef7-e1ab-45f6-91a5-998a6e9bfbfc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:46.053238 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-dd855ef7-e1ab-45f6-91a5-998a6e9bfbfc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1315 microversion: 2.1 time: 0.166640 Jun 27 09:36:46.053983 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 51/103] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:45 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:46.198938 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-8d14341b-4e84-4558-b501-a4e1e69cccd1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:46.199457 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-8d14341b-4e84-4558-b501-a4e1e69cccd1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:46.205428 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8d14341b-4e84-4558-b501-a4e1e69cccd1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:46.205871 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8d14341b-4e84-4558-b501-a4e1e69cccd1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:46.206617 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8d14341b-4e84-4558-b501-a4e1e69cccd1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:46.207062 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8d14341b-4e84-4558-b501-a4e1e69cccd1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:46.354787 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8d14341b-4e84-4558-b501-a4e1e69cccd1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:46.366443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8d14341b-4e84-4558-b501-a4e1e69cccd1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:46.368050 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8d14341b-4e84-4558-b501-a4e1e69cccd1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:46.403558 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-8d14341b-4e84-4558-b501-a4e1e69cccd1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.174741 Jun 27 09:36:46.403558 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 53/104] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:46 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:36:47.026049 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-049f17f9-657d-4f0b-a5e6-8668f343e6a3 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:47.026694 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-049f17f9-657d-4f0b-a5e6-8668f343e6a3 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:47.039861 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-049f17f9-657d-4f0b-a5e6-8668f343e6a3 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:47.040303 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-049f17f9-657d-4f0b-a5e6-8668f343e6a3 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:47.041866 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-049f17f9-657d-4f0b-a5e6-8668f343e6a3 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:47.042466 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-049f17f9-657d-4f0b-a5e6-8668f343e6a3 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:47.072072 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-69c7b223-2c8d-4b09-bcb2-66c6c61d05fd tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:47.072693 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-69c7b223-2c8d-4b09-bcb2-66c6c61d05fd tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:47.082216 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-69c7b223-2c8d-4b09-bcb2-66c6c61d05fd tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:47.082715 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-69c7b223-2c8d-4b09-bcb2-66c6c61d05fd tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:47.083470 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-69c7b223-2c8d-4b09-bcb2-66c6c61d05fd tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:47.084626 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-69c7b223-2c8d-4b09-bcb2-66c6c61d05fd tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:47.258259 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-049f17f9-657d-4f0b-a5e6-8668f343e6a3 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:47.275399 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-049f17f9-657d-4f0b-a5e6-8668f343e6a3 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.255688 Jun 27 09:36:47.277315 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 52/105] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:47 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:47.345001 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-69c7b223-2c8d-4b09-bcb2-66c6c61d05fd tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:47.352920 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-69c7b223-2c8d-4b09-bcb2-66c6c61d05fd tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1315 microversion: 2.1 time: 0.285857 Jun 27 09:36:47.354063 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 54/106] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:47 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:47.419985 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-2d036bdd-12f7-4909-bdb2-6b1b5a0c316c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:47.420770 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-2d036bdd-12f7-4909-bdb2-6b1b5a0c316c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:47.432706 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2d036bdd-12f7-4909-bdb2-6b1b5a0c316c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:47.435075 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2d036bdd-12f7-4909-bdb2-6b1b5a0c316c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:47.439112 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2d036bdd-12f7-4909-bdb2-6b1b5a0c316c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:47.439112 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2d036bdd-12f7-4909-bdb2-6b1b5a0c316c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:47.616231 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2d036bdd-12f7-4909-bdb2-6b1b5a0c316c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:47.626297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2d036bdd-12f7-4909-bdb2-6b1b5a0c316c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:47.627825 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2d036bdd-12f7-4909-bdb2-6b1b5a0c316c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:47.629145 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-2d036bdd-12f7-4909-bdb2-6b1b5a0c316c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.215595 Jun 27 09:36:47.639698 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 53/107] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:47 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:36:48.294204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-fe558233-349d-422f-92e6-bd1fdaaab186 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:48.294997 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-fe558233-349d-422f-92e6-bd1fdaaab186 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:48.301675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fe558233-349d-422f-92e6-bd1fdaaab186 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:48.302673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fe558233-349d-422f-92e6-bd1fdaaab186 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:48.303747 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fe558233-349d-422f-92e6-bd1fdaaab186 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:48.304515 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fe558233-349d-422f-92e6-bd1fdaaab186 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:48.370712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-69aa65c4-06e4-4199-a3e7-d3f38cb539e6 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:48.374386 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-69aa65c4-06e4-4199-a3e7-d3f38cb539e6 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:48.379609 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-69aa65c4-06e4-4199-a3e7-d3f38cb539e6 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:48.380195 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-69aa65c4-06e4-4199-a3e7-d3f38cb539e6 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:48.380842 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-69aa65c4-06e4-4199-a3e7-d3f38cb539e6 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:48.382015 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-69aa65c4-06e4-4199-a3e7-d3f38cb539e6 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:48.464374 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-fe558233-349d-422f-92e6-bd1fdaaab186 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:48.475790 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-fe558233-349d-422f-92e6-bd1fdaaab186 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.186838 Jun 27 09:36:48.476777 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 55/108] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:48 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:36:48.542020 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-69aa65c4-06e4-4199-a3e7-d3f38cb539e6 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:48.551398 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-69aa65c4-06e4-4199-a3e7-d3f38cb539e6 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1315 microversion: 2.1 time: 0.184652 Jun 27 09:36:48.552475 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 54/109] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:48 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:48.648060 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-d6170343-3580-4ece-b677-030415ca7065 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:48.648677 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-d6170343-3580-4ece-b677-030415ca7065 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:48.654883 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d6170343-3580-4ece-b677-030415ca7065 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:48.655330 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d6170343-3580-4ece-b677-030415ca7065 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:48.656115 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d6170343-3580-4ece-b677-030415ca7065 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:48.656550 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d6170343-3580-4ece-b677-030415ca7065 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:48.850846 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d6170343-3580-4ece-b677-030415ca7065 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:48.860820 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d6170343-3580-4ece-b677-030415ca7065 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:48.863009 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d6170343-3580-4ece-b677-030415ca7065 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:48.864474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-d6170343-3580-4ece-b677-030415ca7065 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.220895 Jun 27 09:36:48.865385 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 56/110] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:48 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:36:49.499186 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-993182eb-d54f-4663-86c7-3874411f150f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:49.499836 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-993182eb-d54f-4663-86c7-3874411f150f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:49.506001 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-993182eb-d54f-4663-86c7-3874411f150f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:49.506458 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-993182eb-d54f-4663-86c7-3874411f150f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:49.507224 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-993182eb-d54f-4663-86c7-3874411f150f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:49.507686 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-993182eb-d54f-4663-86c7-3874411f150f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:49.569263 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-5cdb39a5-c756-48f0-b365-f3d9d80b373f tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:49.570001 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-5cdb39a5-c756-48f0-b365-f3d9d80b373f tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:49.577581 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5cdb39a5-c756-48f0-b365-f3d9d80b373f tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:49.580759 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5cdb39a5-c756-48f0-b365-f3d9d80b373f tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:49.580759 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5cdb39a5-c756-48f0-b365-f3d9d80b373f tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:49.580759 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5cdb39a5-c756-48f0-b365-f3d9d80b373f tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:49.714520 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-993182eb-d54f-4663-86c7-3874411f150f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:49.723080 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-993182eb-d54f-4663-86c7-3874411f150f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.227865 Jun 27 09:36:49.724211 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 55/111] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:49 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:36:49.747621 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-5cdb39a5-c756-48f0-b365-f3d9d80b373f tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:49.756637 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-5cdb39a5-c756-48f0-b365-f3d9d80b373f tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1315 microversion: 2.1 time: 0.190877 Jun 27 09:36:49.758870 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 57/112] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:49 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:49.891332 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-42262320-518d-4837-8959-1e9bfd492c05 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:49.892364 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-42262320-518d-4837-8959-1e9bfd492c05 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:49.900268 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-42262320-518d-4837-8959-1e9bfd492c05 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:49.901081 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-42262320-518d-4837-8959-1e9bfd492c05 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:49.901949 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-42262320-518d-4837-8959-1e9bfd492c05 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:49.902671 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-42262320-518d-4837-8959-1e9bfd492c05 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:50.099214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-42262320-518d-4837-8959-1e9bfd492c05 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:50.108233 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-42262320-518d-4837-8959-1e9bfd492c05 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:50.110714 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-42262320-518d-4837-8959-1e9bfd492c05 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:50.111907 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-42262320-518d-4837-8959-1e9bfd492c05 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.224859 Jun 27 09:36:50.112827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 56/113] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:49 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:36:50.511464 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-b1238f24-29ed-4004-9f35-84bd0440dc3c req-d082496f-f2ff-46d0-ad5b-531a6bae3ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5540f679-ef89-453b-91c5-b11dacd977bd", "name": "network-vif-plugged", "status": "completed", "tag": "32d1fb71-3a28-4a00-b9f4-b8c218fba63d"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:36:50.524738 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-b1238f24-29ed-4004-9f35-84bd0440dc3c req-d082496f-f2ff-46d0-ad5b-531a6bae3ea4 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:50.525417 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-b1238f24-29ed-4004-9f35-84bd0440dc3c req-d082496f-f2ff-46d0-ad5b-531a6bae3ea4 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:50.543974 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-b1238f24-29ed-4004-9f35-84bd0440dc3c req-d082496f-f2ff-46d0-ad5b-531a6bae3ea4 service nova] Creating event network-vif-plugged:32d1fb71-3a28-4a00-b9f4-b8c218fba63d for instance 5540f679-ef89-453b-91c5-b11dacd977bd on hv-cinder-84773 Jun 27 09:36:50.550101 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-b1238f24-29ed-4004-9f35-84bd0440dc3c req-d082496f-f2ff-46d0-ad5b-531a6bae3ea4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182170 Jun 27 09:36:50.550962 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 58/114] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:36:50.743207 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-2ccbbd8e-aece-4bda-a4c3-8cc8e789b21d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:50.743975 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-2ccbbd8e-aece-4bda-a4c3-8cc8e789b21d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:50.750491 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2ccbbd8e-aece-4bda-a4c3-8cc8e789b21d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:50.751062 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2ccbbd8e-aece-4bda-a4c3-8cc8e789b21d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:50.752359 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2ccbbd8e-aece-4bda-a4c3-8cc8e789b21d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:50.753108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2ccbbd8e-aece-4bda-a4c3-8cc8e789b21d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:50.773650 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-8ff75274-f3d3-4cbb-84c1-9360f1403dd4 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:50.774580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-8ff75274-f3d3-4cbb-84c1-9360f1403dd4 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:50.781432 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8ff75274-f3d3-4cbb-84c1-9360f1403dd4 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:50.781999 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8ff75274-f3d3-4cbb-84c1-9360f1403dd4 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:50.784045 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8ff75274-f3d3-4cbb-84c1-9360f1403dd4 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:50.789687 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8ff75274-f3d3-4cbb-84c1-9360f1403dd4 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:50.999692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8ff75274-f3d3-4cbb-84c1-9360f1403dd4 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:51.011774 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-8ff75274-f3d3-4cbb-84c1-9360f1403dd4 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1315 microversion: 2.1 time: 0.241399 Jun 27 09:36:51.012798 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 59/115] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:50 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:36:51.044776 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2ccbbd8e-aece-4bda-a4c3-8cc8e789b21d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:51.053375 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-2ccbbd8e-aece-4bda-a4c3-8cc8e789b21d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.315665 Jun 27 09:36:51.054245 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 57/116] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:50 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:51.131929 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-5e545029-fd34-4105-9f75-3dc46e47dd1b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:51.131929 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-5e545029-fd34-4105-9f75-3dc46e47dd1b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:51.138372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5e545029-fd34-4105-9f75-3dc46e47dd1b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:51.138827 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5e545029-fd34-4105-9f75-3dc46e47dd1b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:51.139664 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5e545029-fd34-4105-9f75-3dc46e47dd1b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:51.140113 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5e545029-fd34-4105-9f75-3dc46e47dd1b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:51.144370 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=100 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:51.304667 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-5e545029-fd34-4105-9f75-3dc46e47dd1b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:51.313621 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-5e545029-fd34-4105-9f75-3dc46e47dd1b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:51.323819 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-5e545029-fd34-4105-9f75-3dc46e47dd1b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:51.324982 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-5e545029-fd34-4105-9f75-3dc46e47dd1b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.199314 Jun 27 09:36:51.325550 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 60/117] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:51 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:36:52.029448 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-75a451db-a648-459a-8f95-c7f1404b4ee7 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:52.030789 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-75a451db-a648-459a-8f95-c7f1404b4ee7 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:52.051191 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-75a451db-a648-459a-8f95-c7f1404b4ee7 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:52.051678 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-75a451db-a648-459a-8f95-c7f1404b4ee7 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:52.052714 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-75a451db-a648-459a-8f95-c7f1404b4ee7 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:52.053163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-75a451db-a648-459a-8f95-c7f1404b4ee7 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:52.078328 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-3a78f980-bbe4-45ce-81ff-0afbf36f15f4 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:52.078328 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-3a78f980-bbe4-45ce-81ff-0afbf36f15f4 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:52.078894 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=100 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:36:52.079646 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3a78f980-bbe4-45ce-81ff-0afbf36f15f4 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:52.080352 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3a78f980-bbe4-45ce-81ff-0afbf36f15f4 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:52.081333 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3a78f980-bbe4-45ce-81ff-0afbf36f15f4 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:52.081965 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3a78f980-bbe4-45ce-81ff-0afbf36f15f4 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:52.236584 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-3a78f980-bbe4-45ce-81ff-0afbf36f15f4 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:52.251594 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-3a78f980-bbe4-45ce-81ff-0afbf36f15f4 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.184407 Jun 27 09:36:52.252273 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 61/118] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:52 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:52.277240 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-75a451db-a648-459a-8f95-c7f1404b4ee7 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:52.289828 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-75a451db-a648-459a-8f95-c7f1404b4ee7 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1315 microversion: 2.1 time: 0.264161 Jun 27 09:36:52.290448 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 58/119] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:52 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:52.343332 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a151ce98-74f2-454c-b887-5c5febc4ed13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:52.344052 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-a151ce98-74f2-454c-b887-5c5febc4ed13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:52.350632 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a151ce98-74f2-454c-b887-5c5febc4ed13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:52.351087 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a151ce98-74f2-454c-b887-5c5febc4ed13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:52.351909 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a151ce98-74f2-454c-b887-5c5febc4ed13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:52.352501 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a151ce98-74f2-454c-b887-5c5febc4ed13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:52.532641 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a151ce98-74f2-454c-b887-5c5febc4ed13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:52.539139 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a151ce98-74f2-454c-b887-5c5febc4ed13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:52.541376 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a151ce98-74f2-454c-b887-5c5febc4ed13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:52.542908 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-a151ce98-74f2-454c-b887-5c5febc4ed13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.203633 Jun 27 09:36:52.543570 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 62/120] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:52 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:36:52.567677 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-50dc444d-4275-4a8c-959f-856ce2f57971 req-e509247b-4be1-4da3-b573-ee6d7468851f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7744db71-f29c-4221-af51-e3688c4fbc97", "name": "network-vif-plugged", "status": "completed", "tag": "9720d11f-73fc-4566-a281-54fa01d4bc65"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:36:52.576464 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-50dc444d-4275-4a8c-959f-856ce2f57971 req-e509247b-4be1-4da3-b573-ee6d7468851f service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:52.577145 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-50dc444d-4275-4a8c-959f-856ce2f57971 req-e509247b-4be1-4da3-b573-ee6d7468851f service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:52.588514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-50dc444d-4275-4a8c-959f-856ce2f57971 req-e509247b-4be1-4da3-b573-ee6d7468851f service nova] Creating event network-vif-plugged:9720d11f-73fc-4566-a281-54fa01d4bc65 for instance 7744db71-f29c-4221-af51-e3688c4fbc97 on hv-cinder-84773 Jun 27 09:36:52.596263 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-50dc444d-4275-4a8c-959f-856ce2f57971 req-e509247b-4be1-4da3-b573-ee6d7468851f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031714 Jun 27 09:36:52.597598 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 59/121] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:36:53.274508 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-ca59922e-7413-4643-885e-08a5b257241f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:53.275250 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-ca59922e-7413-4643-885e-08a5b257241f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:53.281886 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ca59922e-7413-4643-885e-08a5b257241f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:53.282330 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ca59922e-7413-4643-885e-08a5b257241f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:53.283112 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ca59922e-7413-4643-885e-08a5b257241f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:53.283576 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ca59922e-7413-4643-885e-08a5b257241f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:53.306429 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-079ab5ba-5444-4107-926c-db4f03a13936 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:53.307115 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-079ab5ba-5444-4107-926c-db4f03a13936 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:53.313638 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-079ab5ba-5444-4107-926c-db4f03a13936 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:53.314073 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-079ab5ba-5444-4107-926c-db4f03a13936 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:53.314822 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-079ab5ba-5444-4107-926c-db4f03a13936 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:53.315247 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-079ab5ba-5444-4107-926c-db4f03a13936 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:53.478925 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-ca59922e-7413-4643-885e-08a5b257241f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:53.483255 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-079ab5ba-5444-4107-926c-db4f03a13936 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:53.486716 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-ca59922e-7413-4643-885e-08a5b257241f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.221488 Jun 27 09:36:53.487285 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 63/122] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:53 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:53.490892 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-079ab5ba-5444-4107-926c-db4f03a13936 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1315 microversion: 2.1 time: 0.188451 Jun 27 09:36:53.491397 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 60/123] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:53 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:36:53.561944 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-22547343-31e7-424e-b948-7f87f9d04552 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:53.563064 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-22547343-31e7-424e-b948-7f87f9d04552 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:53.569795 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-22547343-31e7-424e-b948-7f87f9d04552 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:53.570413 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-22547343-31e7-424e-b948-7f87f9d04552 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:53.571392 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-22547343-31e7-424e-b948-7f87f9d04552 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:53.571938 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-22547343-31e7-424e-b948-7f87f9d04552 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:53.729469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-22547343-31e7-424e-b948-7f87f9d04552 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:53.738530 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-22547343-31e7-424e-b948-7f87f9d04552 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:53.741310 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-22547343-31e7-424e-b948-7f87f9d04552 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:53.742594 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-22547343-31e7-424e-b948-7f87f9d04552 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.184822 Jun 27 09:36:53.753583 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 64/124] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:53 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:36:54.509693 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-dd9eeae4-a0ca-4a49-a0b2-e06fa231dc7f tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:54.510259 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-9ededdc4-8e14-4f29-9b6a-d78a01e920d7 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:54.510704 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-dd9eeae4-a0ca-4a49-a0b2-e06fa231dc7f tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:54.510796 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-9ededdc4-8e14-4f29-9b6a-d78a01e920d7 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:54.514567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dd9eeae4-a0ca-4a49-a0b2-e06fa231dc7f tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:54.515018 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dd9eeae4-a0ca-4a49-a0b2-e06fa231dc7f tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:54.515704 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9ededdc4-8e14-4f29-9b6a-d78a01e920d7 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:54.515870 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dd9eeae4-a0ca-4a49-a0b2-e06fa231dc7f tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:54.516305 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dd9eeae4-a0ca-4a49-a0b2-e06fa231dc7f tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:54.516416 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9ededdc4-8e14-4f29-9b6a-d78a01e920d7 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:54.517362 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9ededdc4-8e14-4f29-9b6a-d78a01e920d7 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:54.517957 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9ededdc4-8e14-4f29-9b6a-d78a01e920d7 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:54.684639 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-dd9eeae4-a0ca-4a49-a0b2-e06fa231dc7f tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:54.691341 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-9ededdc4-8e14-4f29-9b6a-d78a01e920d7 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:54.693878 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-dd9eeae4-a0ca-4a49-a0b2-e06fa231dc7f tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1315 microversion: 2.1 time: 0.190210 Jun 27 09:36:54.694564 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 65/125] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:54 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:54.702085 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-9ededdc4-8e14-4f29-9b6a-d78a01e920d7 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.199132 Jun 27 09:36:54.702841 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 61/126] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:54 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:54.761661 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-296168b4-ef42-4a73-97b7-6435e65886c9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:54.762277 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-296168b4-ef42-4a73-97b7-6435e65886c9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:54.768428 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-296168b4-ef42-4a73-97b7-6435e65886c9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:54.768899 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-296168b4-ef42-4a73-97b7-6435e65886c9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:54.769638 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-296168b4-ef42-4a73-97b7-6435e65886c9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:54.770080 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-296168b4-ef42-4a73-97b7-6435e65886c9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:54.930359 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-296168b4-ef42-4a73-97b7-6435e65886c9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:54.939230 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-296168b4-ef42-4a73-97b7-6435e65886c9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:54.940808 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-296168b4-ef42-4a73-97b7-6435e65886c9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:54.941960 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-296168b4-ef42-4a73-97b7-6435e65886c9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.184368 Jun 27 09:36:54.942615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 66/127] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:54 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:36:55.711449 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-dbd62e3e-10e3-4756-a8ff-f80126a94a61 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:55.712124 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-dbd62e3e-10e3-4756-a8ff-f80126a94a61 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:55.720148 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-0b0277f9-3300-433b-a37f-9a40218cfec9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:55.720763 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-0b0277f9-3300-433b-a37f-9a40218cfec9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:55.722294 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dbd62e3e-10e3-4756-a8ff-f80126a94a61 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:55.722923 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dbd62e3e-10e3-4756-a8ff-f80126a94a61 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:55.723851 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dbd62e3e-10e3-4756-a8ff-f80126a94a61 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:55.724500 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dbd62e3e-10e3-4756-a8ff-f80126a94a61 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:55.728547 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0b0277f9-3300-433b-a37f-9a40218cfec9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:55.728943 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0b0277f9-3300-433b-a37f-9a40218cfec9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:55.732726 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0b0277f9-3300-433b-a37f-9a40218cfec9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:55.733184 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0b0277f9-3300-433b-a37f-9a40218cfec9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:55.886244 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-dbd62e3e-10e3-4756-a8ff-f80126a94a61 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:55.894637 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-dbd62e3e-10e3-4756-a8ff-f80126a94a61 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1315 microversion: 2.1 time: 0.187961 Jun 27 09:36:55.896008 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 62/128] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:55 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:55.911559 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-0b0277f9-3300-433b-a37f-9a40218cfec9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:55.921170 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-0b0277f9-3300-433b-a37f-9a40218cfec9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.204686 Jun 27 09:36:55.921618 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 67/129] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:55 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:36:55.967385 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-73dc4a12-8483-4bdb-8a27-e78a7918b657 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:55.968647 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-73dc4a12-8483-4bdb-8a27-e78a7918b657 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:55.975176 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-73dc4a12-8483-4bdb-8a27-e78a7918b657 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:55.975900 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-73dc4a12-8483-4bdb-8a27-e78a7918b657 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:55.976659 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-73dc4a12-8483-4bdb-8a27-e78a7918b657 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:55.977136 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-73dc4a12-8483-4bdb-8a27-e78a7918b657 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:56.160789 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-73dc4a12-8483-4bdb-8a27-e78a7918b657 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:56.172090 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-73dc4a12-8483-4bdb-8a27-e78a7918b657 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:56.173896 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-73dc4a12-8483-4bdb-8a27-e78a7918b657 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:56.175376 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-73dc4a12-8483-4bdb-8a27-e78a7918b657 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.217335 Jun 27 09:36:56.176113 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 63/130] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:55 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:36:56.912634 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-9c8af3cf-4fc9-4f5a-85bf-cb9417ffa7df tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:56.922131 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-9c8af3cf-4fc9-4f5a-85bf-cb9417ffa7df tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:56.922131 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9c8af3cf-4fc9-4f5a-85bf-cb9417ffa7df tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:56.922131 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9c8af3cf-4fc9-4f5a-85bf-cb9417ffa7df tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:56.922131 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9c8af3cf-4fc9-4f5a-85bf-cb9417ffa7df tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:56.923336 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9c8af3cf-4fc9-4f5a-85bf-cb9417ffa7df tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:56.941733 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-3c8149a3-473c-4b59-bc41-831f5c11304d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:56.943399 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-3c8149a3-473c-4b59-bc41-831f5c11304d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:56.952324 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3c8149a3-473c-4b59-bc41-831f5c11304d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:56.952730 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3c8149a3-473c-4b59-bc41-831f5c11304d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:56.953581 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3c8149a3-473c-4b59-bc41-831f5c11304d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:56.953943 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3c8149a3-473c-4b59-bc41-831f5c11304d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:57.088534 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-9c8af3cf-4fc9-4f5a-85bf-cb9417ffa7df tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:57.096620 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-9c8af3cf-4fc9-4f5a-85bf-cb9417ffa7df tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1501 microversion: 2.1 time: 0.188410 Jun 27 09:36:57.097347 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 68/131] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:56 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1501 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:57.115408 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-3c8149a3-473c-4b59-bc41-831f5c11304d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:57.122943 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-3c8149a3-473c-4b59-bc41-831f5c11304d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.187403 Jun 27 09:36:57.123507 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 64/132] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:56 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:57.195062 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-58256dbf-d39d-4cbe-8ab8-b5859dee9dd2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:57.195829 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-58256dbf-d39d-4cbe-8ab8-b5859dee9dd2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:57.202163 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-58256dbf-d39d-4cbe-8ab8-b5859dee9dd2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:57.202658 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-58256dbf-d39d-4cbe-8ab8-b5859dee9dd2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:57.203427 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-58256dbf-d39d-4cbe-8ab8-b5859dee9dd2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:57.203889 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-58256dbf-d39d-4cbe-8ab8-b5859dee9dd2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:57.342848 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-58256dbf-d39d-4cbe-8ab8-b5859dee9dd2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:57.351370 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-58256dbf-d39d-4cbe-8ab8-b5859dee9dd2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:57.352953 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-58256dbf-d39d-4cbe-8ab8-b5859dee9dd2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:57.354322 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-58256dbf-d39d-4cbe-8ab8-b5859dee9dd2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.164135 Jun 27 09:36:57.354866 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 69/133] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:57 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:36:58.140069 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-4fea45e6-9a4d-4ce1-894e-0b2a4e373554 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:58.140734 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-4fea45e6-9a4d-4ce1-894e-0b2a4e373554 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:58.148595 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4fea45e6-9a4d-4ce1-894e-0b2a4e373554 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:58.149214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4fea45e6-9a4d-4ce1-894e-0b2a4e373554 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:58.149995 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4fea45e6-9a4d-4ce1-894e-0b2a4e373554 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:58.150426 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4fea45e6-9a4d-4ce1-894e-0b2a4e373554 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:58.318312 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4fea45e6-9a4d-4ce1-894e-0b2a4e373554 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:58.325587 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-4fea45e6-9a4d-4ce1-894e-0b2a4e373554 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.189070 Jun 27 09:36:58.325745 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-ed1a0092-d689-4007-93b3-e50718c1cb58 req-22b40d65-2969-46cb-83c8-6d07d3837e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d72055f-6915-43b5-9831-61c2f134e60a", "name": "network-vif-plugged", "status": "completed", "tag": "a233eb88-dce4-49a8-9bf9-7a59a86e981b"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:36:58.327443 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 65/134] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:58 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:36:58.337514 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-ed1a0092-d689-4007-93b3-e50718c1cb58 req-22b40d65-2969-46cb-83c8-6d07d3837e74 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:58.337838 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-ed1a0092-d689-4007-93b3-e50718c1cb58 req-22b40d65-2969-46cb-83c8-6d07d3837e74 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:58.355818 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-ed1a0092-d689-4007-93b3-e50718c1cb58 req-22b40d65-2969-46cb-83c8-6d07d3837e74 service nova] Creating event network-vif-plugged:a233eb88-dce4-49a8-9bf9-7a59a86e981b for instance 1d72055f-6915-43b5-9831-61c2f134e60a on hv-cinder-84773 Jun 27 09:36:58.363600 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-ed1a0092-d689-4007-93b3-e50718c1cb58 req-22b40d65-2969-46cb-83c8-6d07d3837e74 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041862 Jun 27 09:36:58.364208 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 70/135] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:36:58.373784 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-6b58b23e-8177-4dd5-bcf0-c6f8d96c438e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:58.374391 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-6b58b23e-8177-4dd5-bcf0-c6f8d96c438e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:58.381238 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6b58b23e-8177-4dd5-bcf0-c6f8d96c438e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:58.381723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6b58b23e-8177-4dd5-bcf0-c6f8d96c438e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:58.382501 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6b58b23e-8177-4dd5-bcf0-c6f8d96c438e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:58.382943 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6b58b23e-8177-4dd5-bcf0-c6f8d96c438e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:58.514809 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6b58b23e-8177-4dd5-bcf0-c6f8d96c438e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:58.523868 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6b58b23e-8177-4dd5-bcf0-c6f8d96c438e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:58.525386 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6b58b23e-8177-4dd5-bcf0-c6f8d96c438e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:58.526484 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-6b58b23e-8177-4dd5-bcf0-c6f8d96c438e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.156573 Jun 27 09:36:58.527038 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 66/136] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:58 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:36:59.098410 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-2fd9a50b-1599-4f07-acec-5d91f9d80e20 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79fa9b45-565b-4276-a5b6-eaf4088eb368"}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:36:59.099688 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-2fd9a50b-1599-4f07-acec-5d91f9d80e20 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:59.106216 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2fd9a50b-1599-4f07-acec-5d91f9d80e20 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:59.111044 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2fd9a50b-1599-4f07-acec-5d91f9d80e20 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:59.111044 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2fd9a50b-1599-4f07-acec-5d91f9d80e20 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:59.111044 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2fd9a50b-1599-4f07-acec-5d91f9d80e20 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:59.344700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-6e6aa93b-e50c-42ec-8d99-6c2f52478eaa tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:59.345348 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-6e6aa93b-e50c-42ec-8d99-6c2f52478eaa tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:59.352269 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6e6aa93b-e50c-42ec-8d99-6c2f52478eaa tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:59.352727 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6e6aa93b-e50c-42ec-8d99-6c2f52478eaa tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:59.357633 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6e6aa93b-e50c-42ec-8d99-6c2f52478eaa tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:59.357633 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6e6aa93b-e50c-42ec-8d99-6c2f52478eaa tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:59.493971 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6e6aa93b-e50c-42ec-8d99-6c2f52478eaa tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:59.501359 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-6e6aa93b-e50c-42ec-8d99-6c2f52478eaa tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.160572 Jun 27 09:36:59.502092 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 67/137] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:36:59 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:36:59.544441 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-96e7d685-f2b1-4586-8972-71025926b7b1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:36:59.544969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-96e7d685-f2b1-4586-8972-71025926b7b1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:36:59.550946 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-96e7d685-f2b1-4586-8972-71025926b7b1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:59.551400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-96e7d685-f2b1-4586-8972-71025926b7b1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:59.552194 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-96e7d685-f2b1-4586-8972-71025926b7b1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:36:59.553220 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-96e7d685-f2b1-4586-8972-71025926b7b1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:36:59.681343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-96e7d685-f2b1-4586-8972-71025926b7b1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:59.689362 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-96e7d685-f2b1-4586-8972-71025926b7b1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:59.690871 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-96e7d685-f2b1-4586-8972-71025926b7b1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:36:59.692008 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-96e7d685-f2b1-4586-8972-71025926b7b1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.151437 Jun 27 09:36:59.692560 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 68/138] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:36:59 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:37:00.391404 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-b82adae7-89b5-4e73-a88d-6916ef7ddaac req-d9267eb6-6dce-4ede-93d3-928b73c14873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9", "name": "network-vif-plugged", "status": "completed", "tag": "cb15c03b-d1f2-488e-baae-86a39cab937b"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:37:00.400217 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-b82adae7-89b5-4e73-a88d-6916ef7ddaac req-d9267eb6-6dce-4ede-93d3-928b73c14873 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:00.400662 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-b82adae7-89b5-4e73-a88d-6916ef7ddaac req-d9267eb6-6dce-4ede-93d3-928b73c14873 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:00.412030 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-b82adae7-89b5-4e73-a88d-6916ef7ddaac req-d9267eb6-6dce-4ede-93d3-928b73c14873 service nova] Creating event network-vif-plugged:cb15c03b-d1f2-488e-baae-86a39cab937b for instance 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 on hv-cinder-84773 Jun 27 09:37:00.417136 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-b82adae7-89b5-4e73-a88d-6916ef7ddaac req-d9267eb6-6dce-4ede-93d3-928b73c14873 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030016 Jun 27 09:37:00.417925 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 69/139] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:37:00.518370 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-5b8b0a9f-e14b-42c9-9985-25408a021e8c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:00.519101 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-5b8b0a9f-e14b-42c9-9985-25408a021e8c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:00.525296 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5b8b0a9f-e14b-42c9-9985-25408a021e8c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:00.525740 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5b8b0a9f-e14b-42c9-9985-25408a021e8c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:00.526514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5b8b0a9f-e14b-42c9-9985-25408a021e8c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:00.526943 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5b8b0a9f-e14b-42c9-9985-25408a021e8c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:00.658409 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-5b8b0a9f-e14b-42c9-9985-25408a021e8c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:00.666140 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-5b8b0a9f-e14b-42c9-9985-25408a021e8c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.151926 Jun 27 09:37:00.666697 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 70/140] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:00 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:37:00.708560 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-21d85a72-309f-4c80-b48d-66828a852e50 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:00.709157 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-21d85a72-309f-4c80-b48d-66828a852e50 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:00.715002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-21d85a72-309f-4c80-b48d-66828a852e50 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:00.715449 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-21d85a72-309f-4c80-b48d-66828a852e50 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:00.716347 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-21d85a72-309f-4c80-b48d-66828a852e50 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:00.716779 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-21d85a72-309f-4c80-b48d-66828a852e50 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:00.844782 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-21d85a72-309f-4c80-b48d-66828a852e50 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:00.853157 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-21d85a72-309f-4c80-b48d-66828a852e50 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:00.854682 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-21d85a72-309f-4c80-b48d-66828a852e50 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:00.859314 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-21d85a72-309f-4c80-b48d-66828a852e50 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.150897 Jun 27 09:37:00.859314 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 71/141] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:37:00 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:37:01.682148 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-1f395fac-b2be-4dc4-83a0-47eb179643d0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:01.682742 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-1f395fac-b2be-4dc4-83a0-47eb179643d0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:01.689042 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1f395fac-b2be-4dc4-83a0-47eb179643d0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:01.689503 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1f395fac-b2be-4dc4-83a0-47eb179643d0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:01.690249 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1f395fac-b2be-4dc4-83a0-47eb179643d0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:01.690687 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1f395fac-b2be-4dc4-83a0-47eb179643d0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:01.836726 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-1f395fac-b2be-4dc4-83a0-47eb179643d0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:01.845727 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-1f395fac-b2be-4dc4-83a0-47eb179643d0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.167399 Jun 27 09:37:01.857028 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 72/142] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:01 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:37:01.873993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-d9f626b6-dbd8-4b7b-b2a8-c70ebd65ff67 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:01.874598 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-d9f626b6-dbd8-4b7b-b2a8-c70ebd65ff67 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:01.883467 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d9f626b6-dbd8-4b7b-b2a8-c70ebd65ff67 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:01.883931 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d9f626b6-dbd8-4b7b-b2a8-c70ebd65ff67 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:01.884703 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d9f626b6-dbd8-4b7b-b2a8-c70ebd65ff67 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:01.885164 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d9f626b6-dbd8-4b7b-b2a8-c70ebd65ff67 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:02.032234 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-d9f626b6-dbd8-4b7b-b2a8-c70ebd65ff67 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:02.040961 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-d9f626b6-dbd8-4b7b-b2a8-c70ebd65ff67 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:02.042761 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-d9f626b6-dbd8-4b7b-b2a8-c70ebd65ff67 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:02.044409 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-d9f626b6-dbd8-4b7b-b2a8-c70ebd65ff67 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.173957 Jun 27 09:37:02.044992 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 73/143] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:37:01 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:37:02.862671 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-b0f7beaf-a596-4a0f-92ab-045d77e46002 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:02.863271 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-b0f7beaf-a596-4a0f-92ab-045d77e46002 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:02.869752 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b0f7beaf-a596-4a0f-92ab-045d77e46002 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:02.870249 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b0f7beaf-a596-4a0f-92ab-045d77e46002 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:02.871150 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b0f7beaf-a596-4a0f-92ab-045d77e46002 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:02.871609 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b0f7beaf-a596-4a0f-92ab-045d77e46002 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:03.005555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-b0f7beaf-a596-4a0f-92ab-045d77e46002 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:03.013148 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-b0f7beaf-a596-4a0f-92ab-045d77e46002 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.154420 Jun 27 09:37:03.013782 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 74/144] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:02 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:37:03.063625 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-2fd9a50b-1599-4f07-acec-5d91f9d80e20 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "POST /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.969226 Jun 27 09:37:03.069788 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 71/145] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 27 09:36:59 2022] POST /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd/os-volume_attachments => generated 194 bytes in 3976 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:37:03.073046 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-440412f1-a976-440e-9e9c-7fb7d7d2479d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:03.073965 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-440412f1-a976-440e-9e9c-7fb7d7d2479d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:03.083392 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-440412f1-a976-440e-9e9c-7fb7d7d2479d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:03.084119 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-440412f1-a976-440e-9e9c-7fb7d7d2479d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:03.085050 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-440412f1-a976-440e-9e9c-7fb7d7d2479d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:03.085575 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-440412f1-a976-440e-9e9c-7fb7d7d2479d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:03.504966 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-440412f1-a976-440e-9e9c-7fb7d7d2479d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:03.514363 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-440412f1-a976-440e-9e9c-7fb7d7d2479d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:03.515910 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-440412f1-a976-440e-9e9c-7fb7d7d2479d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:03.517170 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-440412f1-a976-440e-9e9c-7fb7d7d2479d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1407 microversion: 2.20 time: 0.457497 Jun 27 09:37:03.517694 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 75/146] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:37:03 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1407 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:37:04.034120 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-9556b446-ddc4-4226-9e2c-2cb44b6b0b54 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:04.034824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-9556b446-ddc4-4226-9e2c-2cb44b6b0b54 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:04.041369 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9556b446-ddc4-4226-9e2c-2cb44b6b0b54 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:04.041815 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9556b446-ddc4-4226-9e2c-2cb44b6b0b54 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:04.042577 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9556b446-ddc4-4226-9e2c-2cb44b6b0b54 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:04.043454 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9556b446-ddc4-4226-9e2c-2cb44b6b0b54 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:04.181199 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-9556b446-ddc4-4226-9e2c-2cb44b6b0b54 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:04.188630 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-9556b446-ddc4-4226-9e2c-2cb44b6b0b54 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.159357 Jun 27 09:37:04.189188 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 72/147] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:04 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:04.535344 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-0514f764-8e48-44d5-81b0-b91d85883441 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:04.535994 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-0514f764-8e48-44d5-81b0-b91d85883441 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:04.543106 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0514f764-8e48-44d5-81b0-b91d85883441 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:04.543565 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0514f764-8e48-44d5-81b0-b91d85883441 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:04.544313 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0514f764-8e48-44d5-81b0-b91d85883441 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:04.544739 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0514f764-8e48-44d5-81b0-b91d85883441 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:04.563469 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=100 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:04.744777 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-0514f764-8e48-44d5-81b0-b91d85883441 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:04.752905 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-0514f764-8e48-44d5-81b0-b91d85883441 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:04.754395 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-0514f764-8e48-44d5-81b0-b91d85883441 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:04.755589 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-0514f764-8e48-44d5-81b0-b91d85883441 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1598 microversion: 2.20 time: 0.224003 Jun 27 09:37:04.756203 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 76/148] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:37:04 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1598 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:37:04.773740 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-96b6d787-5e92-4d8c-b6c5-faa4eecebae6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:04.774457 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-96b6d787-5e92-4d8c-b6c5-faa4eecebae6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:04.781260 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-96b6d787-5e92-4d8c-b6c5-faa4eecebae6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:04.781405 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-96b6d787-5e92-4d8c-b6c5-faa4eecebae6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:04.784807 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-96b6d787-5e92-4d8c-b6c5-faa4eecebae6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:04.784807 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-96b6d787-5e92-4d8c-b6c5-faa4eecebae6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:04.862802 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-96b6d787-5e92-4d8c-b6c5-faa4eecebae6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093271 Jun 27 09:37:04.863516 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 73/149] 10.222.0.64 () {60 vars in 1315 bytes} [Mon Jun 27 09:37:04 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 09:37:05.206273 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-6477eb99-6005-4b03-be87-216130a1cc62 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:05.207519 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-6477eb99-6005-4b03-be87-216130a1cc62 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:05.215186 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6477eb99-6005-4b03-be87-216130a1cc62 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:05.215917 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6477eb99-6005-4b03-be87-216130a1cc62 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:05.216772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6477eb99-6005-4b03-be87-216130a1cc62 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:05.217526 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6477eb99-6005-4b03-be87-216130a1cc62 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:05.409545 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6477eb99-6005-4b03-be87-216130a1cc62 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:05.422989 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-6477eb99-6005-4b03-be87-216130a1cc62 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1322 microversion: 2.1 time: 0.220541 Jun 27 09:37:05.426417 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 77/150] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:05 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:06.268549 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-e82ec5c9-9cd8-4dc3-874a-d78157f55d8d req-bcec6a74-ff58-426d-ad76-deea87d38fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d72055f-6915-43b5-9831-61c2f134e60a", "tag": "a233eb88-dce4-49a8-9bf9-7a59a86e981b"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:37:06.278853 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-e82ec5c9-9cd8-4dc3-874a-d78157f55d8d req-bcec6a74-ff58-426d-ad76-deea87d38fb6 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:06.279558 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-e82ec5c9-9cd8-4dc3-874a-d78157f55d8d req-bcec6a74-ff58-426d-ad76-deea87d38fb6 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:06.320513 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-e82ec5c9-9cd8-4dc3-874a-d78157f55d8d req-bcec6a74-ff58-426d-ad76-deea87d38fb6 service nova] Creating event network-changed:a233eb88-dce4-49a8-9bf9-7a59a86e981b for instance 1d72055f-6915-43b5-9831-61c2f134e60a on hv-cinder-84773 Jun 27 09:37:06.341767 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-e82ec5c9-9cd8-4dc3-874a-d78157f55d8d req-bcec6a74-ff58-426d-ad76-deea87d38fb6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076746 Jun 27 09:37:06.342937 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 74/151] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:37:06.442161 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f479639d-08e9-4a40-87b2-abd114e57e8c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:06.442769 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-f479639d-08e9-4a40-87b2-abd114e57e8c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:06.459045 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f479639d-08e9-4a40-87b2-abd114e57e8c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:06.459496 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f479639d-08e9-4a40-87b2-abd114e57e8c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:06.460295 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f479639d-08e9-4a40-87b2-abd114e57e8c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:06.460731 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f479639d-08e9-4a40-87b2-abd114e57e8c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:06.696650 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f479639d-08e9-4a40-87b2-abd114e57e8c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:06.705977 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-f479639d-08e9-4a40-87b2-abd114e57e8c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1516 microversion: 2.1 time: 0.267334 Jun 27 09:37:06.717979 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 78/152] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:06 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1516 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:06.728562 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-d4432671-a40d-4379-a561-a927e3ae1ec2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:37:06.729856 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-d4432671-a40d-4379-a561-a927e3ae1ec2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:06.735481 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=72 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:06.738192 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d4432671-a40d-4379-a561-a927e3ae1ec2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:06.738923 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d4432671-a40d-4379-a561-a927e3ae1ec2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:06.739880 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d4432671-a40d-4379-a561-a927e3ae1ec2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:06.740417 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d4432671-a40d-4379-a561-a927e3ae1ec2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:06.769871 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.objects.instance [None req-d4432671-a40d-4379-a561-a927e3ae1ec2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lazy-loading 'flavor' on Instance uuid 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 {{(pid=124870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:37:06.919862 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:07.141624 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-d4432671-a40d-4379-a561-a927e3ae1ec2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "POST /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9/action" status: 200 len: 32 microversion: 2.1 time: 0.419493 Jun 27 09:37:07.142651 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 75/153] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 27 09:37:06 2022] POST /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9/action => generated 32 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 09:37:07.151941 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f1b65e77-d4ff-49fb-a364-ab410ce70120 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:07.152743 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-f1b65e77-d4ff-49fb-a364-ab410ce70120 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:07.159822 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f1b65e77-d4ff-49fb-a364-ab410ce70120 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:07.160263 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f1b65e77-d4ff-49fb-a364-ab410ce70120 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:07.161025 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f1b65e77-d4ff-49fb-a364-ab410ce70120 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:07.161714 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f1b65e77-d4ff-49fb-a364-ab410ce70120 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:07.303863 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f1b65e77-d4ff-49fb-a364-ab410ce70120 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:07.311773 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-f1b65e77-d4ff-49fb-a364-ab410ce70120 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.164073 Jun 27 09:37:07.312371 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 79/154] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:07 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:08.338422 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c675b9fa-f2c6-48d6-a5fa-cb29192aedb8 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:08.339161 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-c675b9fa-f2c6-48d6-a5fa-cb29192aedb8 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:08.346975 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c675b9fa-f2c6-48d6-a5fa-cb29192aedb8 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:08.347427 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c675b9fa-f2c6-48d6-a5fa-cb29192aedb8 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:08.348229 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c675b9fa-f2c6-48d6-a5fa-cb29192aedb8 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:08.348665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c675b9fa-f2c6-48d6-a5fa-cb29192aedb8 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:08.478028 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-c675b9fa-f2c6-48d6-a5fa-cb29192aedb8 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:08.485412 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-c675b9fa-f2c6-48d6-a5fa-cb29192aedb8 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.152776 Jun 27 09:37:08.485966 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 76/155] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:08 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:09.502068 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e6d7f0fd-269e-4560-a11c-dfbce245da45 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:09.502678 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-e6d7f0fd-269e-4560-a11c-dfbce245da45 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:09.508965 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e6d7f0fd-269e-4560-a11c-dfbce245da45 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:09.509414 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e6d7f0fd-269e-4560-a11c-dfbce245da45 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:09.510068 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e6d7f0fd-269e-4560-a11c-dfbce245da45 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:09.510508 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e6d7f0fd-269e-4560-a11c-dfbce245da45 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:09.639408 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e6d7f0fd-269e-4560-a11c-dfbce245da45 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:09.647495 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-e6d7f0fd-269e-4560-a11c-dfbce245da45 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.149252 Jun 27 09:37:09.648093 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 80/156] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:09 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:10.665084 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-6b8aafb7-43ed-478c-afc6-4ecf7905a24b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:10.665681 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-6b8aafb7-43ed-478c-afc6-4ecf7905a24b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:10.672649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6b8aafb7-43ed-478c-afc6-4ecf7905a24b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:10.673093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6b8aafb7-43ed-478c-afc6-4ecf7905a24b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:10.673952 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6b8aafb7-43ed-478c-afc6-4ecf7905a24b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:10.674391 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6b8aafb7-43ed-478c-afc6-4ecf7905a24b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:10.812792 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-6b8aafb7-43ed-478c-afc6-4ecf7905a24b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:10.821323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-6b8aafb7-43ed-478c-afc6-4ecf7905a24b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.160818 Jun 27 09:37:10.821887 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 77/157] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:10 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:11.838129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-456e640b-6bfe-46c3-8cfa-a847de7bbc6e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:11.838828 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-456e640b-6bfe-46c3-8cfa-a847de7bbc6e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:11.845030 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-456e640b-6bfe-46c3-8cfa-a847de7bbc6e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:11.845472 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-456e640b-6bfe-46c3-8cfa-a847de7bbc6e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:11.846236 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-456e640b-6bfe-46c3-8cfa-a847de7bbc6e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:11.846667 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-456e640b-6bfe-46c3-8cfa-a847de7bbc6e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:12.024087 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-456e640b-6bfe-46c3-8cfa-a847de7bbc6e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:12.035661 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-456e640b-6bfe-46c3-8cfa-a847de7bbc6e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.200556 Jun 27 09:37:12.038360 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 81/158] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:11 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:13.054214 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-013394ac-5bdf-423d-89c7-715cbf6be85a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:13.054827 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-013394ac-5bdf-423d-89c7-715cbf6be85a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:13.061435 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-013394ac-5bdf-423d-89c7-715cbf6be85a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:13.063493 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-013394ac-5bdf-423d-89c7-715cbf6be85a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:13.063493 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-013394ac-5bdf-423d-89c7-715cbf6be85a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:13.063493 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-013394ac-5bdf-423d-89c7-715cbf6be85a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:13.207768 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-013394ac-5bdf-423d-89c7-715cbf6be85a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:13.214408 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-013394ac-5bdf-423d-89c7-715cbf6be85a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.163816 Jun 27 09:37:13.215626 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 78/159] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:13 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:14.231933 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-26772643-1d8d-4c74-adff-c845b2ac042b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:14.232542 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-26772643-1d8d-4c74-adff-c845b2ac042b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:14.234509 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=74 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:14.241004 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-26772643-1d8d-4c74-adff-c845b2ac042b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:14.241481 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-26772643-1d8d-4c74-adff-c845b2ac042b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:14.242331 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-26772643-1d8d-4c74-adff-c845b2ac042b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:14.242856 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-26772643-1d8d-4c74-adff-c845b2ac042b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:14.408181 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-26772643-1d8d-4c74-adff-c845b2ac042b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:14.417037 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-26772643-1d8d-4c74-adff-c845b2ac042b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.188139 Jun 27 09:37:14.417037 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 82/160] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:14 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:15.432943 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-4be5c65f-6b31-433d-a224-f2ad7442b271 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:15.433547 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-4be5c65f-6b31-433d-a224-f2ad7442b271 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:15.439956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4be5c65f-6b31-433d-a224-f2ad7442b271 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:15.443519 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4be5c65f-6b31-433d-a224-f2ad7442b271 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:15.443519 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4be5c65f-6b31-433d-a224-f2ad7442b271 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:15.443519 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4be5c65f-6b31-433d-a224-f2ad7442b271 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:15.613284 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4be5c65f-6b31-433d-a224-f2ad7442b271 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:15.621621 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-4be5c65f-6b31-433d-a224-f2ad7442b271 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.192450 Jun 27 09:37:15.622334 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 79/161] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:15 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:16.587767 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-de552bcd-c628-43b2-93b0-155f3b1d64bc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:16.588840 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-de552bcd-c628-43b2-93b0-155f3b1d64bc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:16.594826 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-de552bcd-c628-43b2-93b0-155f3b1d64bc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:16.595270 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-de552bcd-c628-43b2-93b0-155f3b1d64bc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:16.596093 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-de552bcd-c628-43b2-93b0-155f3b1d64bc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:16.596614 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-de552bcd-c628-43b2-93b0-155f3b1d64bc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:16.624636 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-de552bcd-c628-43b2-93b0-155f3b1d64bc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Going to try to terminate instance {{(pid=124869) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 09:37:16.639067 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-ea53c96b-0b50-4db5-a583-42db51873955 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:16.639826 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-ea53c96b-0b50-4db5-a583-42db51873955 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:16.646802 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ea53c96b-0b50-4db5-a583-42db51873955 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:16.647192 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ea53c96b-0b50-4db5-a583-42db51873955 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:16.648054 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ea53c96b-0b50-4db5-a583-42db51873955 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:16.648737 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ea53c96b-0b50-4db5-a583-42db51873955 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:16.992716 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-ea53c96b-0b50-4db5-a583-42db51873955 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:17.000753 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-ea53c96b-0b50-4db5-a583-42db51873955 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.365424 Jun 27 09:37:17.021673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 80/162] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:16 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:37:17.079984 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-de552bcd-c628-43b2-93b0-155f3b1d64bc tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 204 len: 0 microversion: 2.1 time: 0.495685 Jun 27 09:37:17.080574 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 83/163] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:37:16 2022] DELETE /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 09:37:17.089289 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-baa3b1d3-e840-40c1-a4a0-38746220531e tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:17.092065 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-baa3b1d3-e840-40c1-a4a0-38746220531e tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:17.096390 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-baa3b1d3-e840-40c1-a4a0-38746220531e tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:17.096838 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-baa3b1d3-e840-40c1-a4a0-38746220531e tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:17.097591 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-baa3b1d3-e840-40c1-a4a0-38746220531e tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:17.098024 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-baa3b1d3-e840-40c1-a4a0-38746220531e tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:17.304772 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-baa3b1d3-e840-40c1-a4a0-38746220531e tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:17.313110 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-baa3b1d3-e840-40c1-a4a0-38746220531e tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1553 microversion: 2.1 time: 0.227684 Jun 27 09:37:17.323390 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 81/164] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:17 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1553 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:18.030780 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f54e2b53-0c81-45c7-8998-a01d2c310158 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:18.031776 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-f54e2b53-0c81-45c7-8998-a01d2c310158 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:18.038210 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f54e2b53-0c81-45c7-8998-a01d2c310158 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:18.038647 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f54e2b53-0c81-45c7-8998-a01d2c310158 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:18.039753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f54e2b53-0c81-45c7-8998-a01d2c310158 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:18.040183 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f54e2b53-0c81-45c7-8998-a01d2c310158 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:18.178914 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f54e2b53-0c81-45c7-8998-a01d2c310158 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:18.186364 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-f54e2b53-0c81-45c7-8998-a01d2c310158 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.159835 Jun 27 09:37:18.186960 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 84/165] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:18 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:18.330564 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-25aec7b0-0fa6-4fe0-b785-54b4c21271e6 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:18.331176 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-25aec7b0-0fa6-4fe0-b785-54b4c21271e6 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:18.338165 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-25aec7b0-0fa6-4fe0-b785-54b4c21271e6 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:18.338616 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-25aec7b0-0fa6-4fe0-b785-54b4c21271e6 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:18.339384 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-25aec7b0-0fa6-4fe0-b785-54b4c21271e6 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:18.339847 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-25aec7b0-0fa6-4fe0-b785-54b4c21271e6 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:18.469223 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-25aec7b0-0fa6-4fe0-b785-54b4c21271e6 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:18.477795 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-25aec7b0-0fa6-4fe0-b785-54b4c21271e6 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1553 microversion: 2.1 time: 0.151010 Jun 27 09:37:18.478368 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 82/166] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:18 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:19.203868 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-6ed737ca-36b7-453c-a886-94d277a9e310 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:19.204733 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-6ed737ca-36b7-453c-a886-94d277a9e310 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:19.212083 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6ed737ca-36b7-453c-a886-94d277a9e310 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:19.212663 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6ed737ca-36b7-453c-a886-94d277a9e310 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:19.213584 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6ed737ca-36b7-453c-a886-94d277a9e310 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:19.214148 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6ed737ca-36b7-453c-a886-94d277a9e310 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:19.353686 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6ed737ca-36b7-453c-a886-94d277a9e310 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:19.362039 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-6ed737ca-36b7-453c-a886-94d277a9e310 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.162354 Jun 27 09:37:19.365718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 85/167] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:19 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:19.494804 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-cbf7fe8d-6360-4548-b11d-c53795ee51b2 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:19.495418 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-cbf7fe8d-6360-4548-b11d-c53795ee51b2 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:19.502009 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cbf7fe8d-6360-4548-b11d-c53795ee51b2 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:19.502441 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cbf7fe8d-6360-4548-b11d-c53795ee51b2 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:19.503207 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cbf7fe8d-6360-4548-b11d-c53795ee51b2 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:19.503687 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cbf7fe8d-6360-4548-b11d-c53795ee51b2 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:19.696041 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-cbf7fe8d-6360-4548-b11d-c53795ee51b2 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:19.704039 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-cbf7fe8d-6360-4548-b11d-c53795ee51b2 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1553 microversion: 2.1 time: 0.213054 Jun 27 09:37:19.704533 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 83/168] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:19 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1553 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:20.381006 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-85fb3915-fb50-4800-81b5-1054b713ba43 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:20.381620 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-85fb3915-fb50-4800-81b5-1054b713ba43 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:20.387707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-85fb3915-fb50-4800-81b5-1054b713ba43 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:20.388152 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-85fb3915-fb50-4800-81b5-1054b713ba43 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:20.388909 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-85fb3915-fb50-4800-81b5-1054b713ba43 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:20.389337 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-85fb3915-fb50-4800-81b5-1054b713ba43 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:20.522568 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-85fb3915-fb50-4800-81b5-1054b713ba43 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:20.530704 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-85fb3915-fb50-4800-81b5-1054b713ba43 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.154060 Jun 27 09:37:20.531398 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 86/169] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:20 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:20.720993 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a6248861-3803-4b5d-85b7-dfd649d0e616 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:20.721612 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-a6248861-3803-4b5d-85b7-dfd649d0e616 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:20.728638 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a6248861-3803-4b5d-85b7-dfd649d0e616 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:20.729040 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a6248861-3803-4b5d-85b7-dfd649d0e616 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:20.729808 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a6248861-3803-4b5d-85b7-dfd649d0e616 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:20.730251 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a6248861-3803-4b5d-85b7-dfd649d0e616 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:20.872505 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a6248861-3803-4b5d-85b7-dfd649d0e616 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:20.882328 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-a6248861-3803-4b5d-85b7-dfd649d0e616 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1553 microversion: 2.1 time: 0.165120 Jun 27 09:37:20.911518 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 84/170] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:20 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:21.547897 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-49dff88d-2966-4e89-8448-e612481f84f4 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:21.548469 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-49dff88d-2966-4e89-8448-e612481f84f4 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:21.554498 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-49dff88d-2966-4e89-8448-e612481f84f4 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:21.554945 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-49dff88d-2966-4e89-8448-e612481f84f4 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:21.555738 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-49dff88d-2966-4e89-8448-e612481f84f4 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:21.556181 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-49dff88d-2966-4e89-8448-e612481f84f4 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:21.680264 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-49dff88d-2966-4e89-8448-e612481f84f4 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:21.687623 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-49dff88d-2966-4e89-8448-e612481f84f4 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.143674 Jun 27 09:37:21.688185 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 87/171] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:21 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:21.899689 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-89441235-f018-4c9a-bffa-2dde0e5fa60d tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:21.900300 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-89441235-f018-4c9a-bffa-2dde0e5fa60d tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:21.906746 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-89441235-f018-4c9a-bffa-2dde0e5fa60d tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:21.907190 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-89441235-f018-4c9a-bffa-2dde0e5fa60d tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:21.907968 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-89441235-f018-4c9a-bffa-2dde0e5fa60d tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:21.908402 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-89441235-f018-4c9a-bffa-2dde0e5fa60d tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:22.034276 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-89441235-f018-4c9a-bffa-2dde0e5fa60d tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:22.042731 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-89441235-f018-4c9a-bffa-2dde0e5fa60d tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1553 microversion: 2.1 time: 0.147178 Jun 27 09:37:22.047960 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 85/172] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:21 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:22.704193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-6e465dd0-52ec-4bd8-898b-c94b0f1b7264 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:22.704759 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-6e465dd0-52ec-4bd8-898b-c94b0f1b7264 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:22.710763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6e465dd0-52ec-4bd8-898b-c94b0f1b7264 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:22.711233 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6e465dd0-52ec-4bd8-898b-c94b0f1b7264 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:22.712075 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6e465dd0-52ec-4bd8-898b-c94b0f1b7264 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:22.712513 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6e465dd0-52ec-4bd8-898b-c94b0f1b7264 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:22.850303 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6e465dd0-52ec-4bd8-898b-c94b0f1b7264 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:22.857840 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-6e465dd0-52ec-4bd8-898b-c94b0f1b7264 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.157638 Jun 27 09:37:22.858408 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 88/173] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:22 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:23.058944 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-878c51b7-4df2-4bdc-8b45-32437a36481e tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:23.059558 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-878c51b7-4df2-4bdc-8b45-32437a36481e tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:23.066456 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-878c51b7-4df2-4bdc-8b45-32437a36481e tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:23.066903 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-878c51b7-4df2-4bdc-8b45-32437a36481e tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:23.067693 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-878c51b7-4df2-4bdc-8b45-32437a36481e tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:23.068121 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-878c51b7-4df2-4bdc-8b45-32437a36481e tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:23.199697 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-878c51b7-4df2-4bdc-8b45-32437a36481e tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:23.207672 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-878c51b7-4df2-4bdc-8b45-32437a36481e tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1553 microversion: 2.1 time: 0.152622 Jun 27 09:37:23.208460 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 86/174] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:23 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:23.874709 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-621f2c0a-1095-48f3-a93e-b59fde50f564 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:23.875316 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-621f2c0a-1095-48f3-a93e-b59fde50f564 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:23.882921 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-621f2c0a-1095-48f3-a93e-b59fde50f564 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:23.883187 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-621f2c0a-1095-48f3-a93e-b59fde50f564 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:23.883993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-621f2c0a-1095-48f3-a93e-b59fde50f564 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:23.884428 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-621f2c0a-1095-48f3-a93e-b59fde50f564 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:24.027328 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-621f2c0a-1095-48f3-a93e-b59fde50f564 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:24.032303 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-621f2c0a-1095-48f3-a93e-b59fde50f564 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.161449 Jun 27 09:37:24.032867 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 89/175] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:23 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:24.225766 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-054d56b6-3e88-457f-bf09-cb83a8478850 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:24.226391 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-054d56b6-3e88-457f-bf09-cb83a8478850 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:24.232734 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-054d56b6-3e88-457f-bf09-cb83a8478850 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:24.233178 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-054d56b6-3e88-457f-bf09-cb83a8478850 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:24.233932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-054d56b6-3e88-457f-bf09-cb83a8478850 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:24.234362 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-054d56b6-3e88-457f-bf09-cb83a8478850 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:24.361065 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-054d56b6-3e88-457f-bf09-cb83a8478850 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:24.369125 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-054d56b6-3e88-457f-bf09-cb83a8478850 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1553 microversion: 2.1 time: 0.147625 Jun 27 09:37:24.369689 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 87/176] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:24 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:25.049509 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-3cefc59b-7127-4595-bf33-6d210f727e14 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:25.050106 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-3cefc59b-7127-4595-bf33-6d210f727e14 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:25.056613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3cefc59b-7127-4595-bf33-6d210f727e14 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:25.057021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3cefc59b-7127-4595-bf33-6d210f727e14 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:25.057772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3cefc59b-7127-4595-bf33-6d210f727e14 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:25.058201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3cefc59b-7127-4595-bf33-6d210f727e14 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:25.190788 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-3cefc59b-7127-4595-bf33-6d210f727e14 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:25.199030 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-3cefc59b-7127-4595-bf33-6d210f727e14 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.153156 Jun 27 09:37:25.199735 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 90/177] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:25 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:25.386631 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-838ef893-6c36-4c6e-b50b-42887512e02b tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:25.387264 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-838ef893-6c36-4c6e-b50b-42887512e02b tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:25.393685 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-838ef893-6c36-4c6e-b50b-42887512e02b tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:25.394129 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-838ef893-6c36-4c6e-b50b-42887512e02b tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:25.394885 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-838ef893-6c36-4c6e-b50b-42887512e02b tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:25.395316 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-838ef893-6c36-4c6e-b50b-42887512e02b tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:25.520159 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-838ef893-6c36-4c6e-b50b-42887512e02b tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:25.527968 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-838ef893-6c36-4c6e-b50b-42887512e02b tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1553 microversion: 2.1 time: 0.145152 Jun 27 09:37:25.528530 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 88/178] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:25 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1553 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:26.215838 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-98901edc-f7e1-446b-a420-581d03f14275 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:26.216447 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-98901edc-f7e1-446b-a420-581d03f14275 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:26.222544 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-98901edc-f7e1-446b-a420-581d03f14275 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:26.223017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-98901edc-f7e1-446b-a420-581d03f14275 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:26.223800 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-98901edc-f7e1-446b-a420-581d03f14275 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:26.224265 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-98901edc-f7e1-446b-a420-581d03f14275 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:26.242726 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:26.507040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-98901edc-f7e1-446b-a420-581d03f14275 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:26.514591 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-98901edc-f7e1-446b-a420-581d03f14275 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.302490 Jun 27 09:37:26.515163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 91/179] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:26 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:26.545758 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-b7462ac2-accb-40e2-a7a2-4e0de2ab4cc7 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:26.546432 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-b7462ac2-accb-40e2-a7a2-4e0de2ab4cc7 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:26.553143 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b7462ac2-accb-40e2-a7a2-4e0de2ab4cc7 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:26.553593 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b7462ac2-accb-40e2-a7a2-4e0de2ab4cc7 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:26.554388 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b7462ac2-accb-40e2-a7a2-4e0de2ab4cc7 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:26.554824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b7462ac2-accb-40e2-a7a2-4e0de2ab4cc7 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:26.698032 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-b7462ac2-accb-40e2-a7a2-4e0de2ab4cc7 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:26.706315 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-b7462ac2-accb-40e2-a7a2-4e0de2ab4cc7 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1553 microversion: 2.1 time: 0.164453 Jun 27 09:37:26.706874 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 89/180] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:26 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:27.150584 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-f103df7e-1845-4fd5-a8cf-f6428de162d4 req-6daae709-d5a0-4066-90d8-5321499c181d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5540f679-ef89-453b-91c5-b11dacd977bd", "name": "network-vif-deleted", "tag": "32d1fb71-3a28-4a00-b9f4-b8c218fba63d"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:37:27.160808 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-f103df7e-1845-4fd5-a8cf-f6428de162d4 req-6daae709-d5a0-4066-90d8-5321499c181d service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:27.161287 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-f103df7e-1845-4fd5-a8cf-f6428de162d4 req-6daae709-d5a0-4066-90d8-5321499c181d service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:27.174237 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-f103df7e-1845-4fd5-a8cf-f6428de162d4 req-6daae709-d5a0-4066-90d8-5321499c181d service nova] Creating event network-vif-deleted:32d1fb71-3a28-4a00-b9f4-b8c218fba63d for instance 5540f679-ef89-453b-91c5-b11dacd977bd on hv-cinder-84773 Jun 27 09:37:27.180643 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-f103df7e-1845-4fd5-a8cf-f6428de162d4 req-6daae709-d5a0-4066-90d8-5321499c181d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033854 Jun 27 09:37:27.181484 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 92/181] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:37:27.531866 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-1676aa69-22f2-4e09-8326-063143a440c2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:27.532477 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-1676aa69-22f2-4e09-8326-063143a440c2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:27.539163 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1676aa69-22f2-4e09-8326-063143a440c2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:27.539902 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1676aa69-22f2-4e09-8326-063143a440c2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:27.540662 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1676aa69-22f2-4e09-8326-063143a440c2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:27.541153 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1676aa69-22f2-4e09-8326-063143a440c2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:27.669586 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-1676aa69-22f2-4e09-8326-063143a440c2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:27.679522 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-1676aa69-22f2-4e09-8326-063143a440c2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.151388 Jun 27 09:37:27.689490 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 90/182] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:27 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:27.724950 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-62ea0338-bbba-459d-af67-a6b6f02da3ed tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:27.725645 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-62ea0338-bbba-459d-af67-a6b6f02da3ed tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:27.732248 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-62ea0338-bbba-459d-af67-a6b6f02da3ed tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:27.738838 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-62ea0338-bbba-459d-af67-a6b6f02da3ed tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:27.738838 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-62ea0338-bbba-459d-af67-a6b6f02da3ed tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:27.738838 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-62ea0338-bbba-459d-af67-a6b6f02da3ed tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:27.799846 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-62ea0338-bbba-459d-af67-a6b6f02da3ed tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5d5a3f43c544368118125f2e194565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84dd698260134176acd4f4892911ab05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:27.807925 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-62ea0338-bbba-459d-af67-a6b6f02da3ed tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 200 len: 1346 microversion: 2.1 time: 0.087092 Jun 27 09:37:27.808770 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 93/183] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:27 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:28.697339 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c35b545c-1765-4ae2-90a1-480d7759d048 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:28.698129 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-c35b545c-1765-4ae2-90a1-480d7759d048 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:28.708013 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c35b545c-1765-4ae2-90a1-480d7759d048 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:28.708496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c35b545c-1765-4ae2-90a1-480d7759d048 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:28.709271 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c35b545c-1765-4ae2-90a1-480d7759d048 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:28.709887 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c35b545c-1765-4ae2-90a1-480d7759d048 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:28.825547 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-3de1d6e8-4b4f-453d-a7c3-47d4354b6035 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:28.826283 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-3de1d6e8-4b4f-453d-a7c3-47d4354b6035 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:28.832910 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3de1d6e8-4b4f-453d-a7c3-47d4354b6035 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:28.833598 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3de1d6e8-4b4f-453d-a7c3-47d4354b6035 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:28.835430 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3de1d6e8-4b4f-453d-a7c3-47d4354b6035 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:28.836055 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3de1d6e8-4b4f-453d-a7c3-47d4354b6035 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:28.858218 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-3de1d6e8-4b4f-453d-a7c3-47d4354b6035 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] HTTP exception thrown: Instance 5540f679-ef89-453b-91c5-b11dacd977bd could not be found. Jun 27 09:37:28.862878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-3de1d6e8-4b4f-453d-a7c3-47d4354b6035 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Request method failure captured: Jun 27 09:37:28.862878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd HTTP/1.1 Jun 27 09:37:28.862878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:37:28.862878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:37:28.862878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:37:28.862878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:37:28.862878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:37:28.862878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:37:28.862878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:37:28.862878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:37:28.862878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXoPicHp459U66xm3i41NtzftGp_Wf0fiQ5zAZDB54eLIMYbXs8zSPmmdiycQw_YwQCZv86oUsfMem1FmmkDPXBbwZt6hajG7jDktx3MI4Hk5PWMAraLBhDAwp8HVH3n9BqU0cpZ6HixN6-7QLtDB_UX0egncFtO6OtqR6143k3jDwc Jun 27 09:37:28.862878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:37:28.862878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:37:28.862878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:37:28.862878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:37:28.862878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:37:28.862878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:37:28.862878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: 84dd698260134176acd4f4892911ab05 Jun 27 09:37:28.862878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-DeleteServersTestJSON-576591190 Jun 27 09:37:28.862878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:37:28.862878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:37:28.864280 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/84dd698260134176acd4f4892911ab05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/84dd698260134176acd4f4892911ab05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/84dd698260134176acd4f4892911ab05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_84dd698260134176acd4f4892911ab05", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:37:28.864280 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-DeleteServersTestJSON-576591190 Jun 27 09:37:28.864280 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: 84dd698260134176acd4f4892911ab05 Jun 27 09:37:28.864280 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-DeleteServersTestJSON-576591190 Jun 27 09:37:28.864280 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-DeleteServersTestJSON-576591190-project Jun 27 09:37:28.864280 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:37:28.864280 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:37:28.864280 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: 9b5d5a3f43c544368118125f2e194565 Jun 27 09:37:28.864280 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-DeleteServersTestJSON-576591190-project Jun 27 09:37:28.864280 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: > Jun 27 09:37:28.864280 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Instance 5540f679-ef89-453b-91c5-b11dacd977bd could not be found. Jun 27 09:37:28.864280 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'id': '5540f679-ef89-453b-91c5-b11dacd977bd'} Jun 27 09:37:28.866256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:37:28.866256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:37:28.866256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:37:28.866256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:37:28.866256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:37:28.866256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:37:28.866256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:37:28.866256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:37:28.866256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:37:28.866256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:37:28.866256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5540f679-ef89-453b-91c5-b11dacd977bd could not be found. Jun 27 09:37:28.866256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:37:28.866256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:37:28.866256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:37:28.866256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:37:28.866256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:37:28.866256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:37:28.866256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:37:28.866256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:37:28.866256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:37:28.867664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:37:28.867664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:37:28.867664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:37:28.867664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:37:28.867664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:37:28.867664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:37:28.867664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:37:28.867664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5540f679-ef89-453b-91c5-b11dacd977bd could not be found. Jun 27 09:37:28.867664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:37:28.867664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:37:28.867664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:37:28.867664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:37:28.867664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:37:28.867664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:37:28.867664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:37:28.867664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:37:28.867664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5540f679-ef89-453b-91c5-b11dacd977bd could not be found. Jun 27 09:37:28.867664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:37:28.868853 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-3de1d6e8-4b4f-453d-a7c3-47d4354b6035 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Returning 404 to user: Instance 5540f679-ef89-453b-91c5-b11dacd977bd could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:37:28.868853 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-3de1d6e8-4b4f-453d-a7c3-47d4354b6035 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 404 len: 111 microversion: 2.1 time: 0.043173 Jun 27 09:37:28.868853 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 94/184] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:28 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:37:28.876411 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-c35b545c-1765-4ae2-90a1-480d7759d048 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:28.883272 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:28.886137 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-c35b545c-1765-4ae2-90a1-480d7759d048 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.192678 Jun 27 09:37:28.886730 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 91/185] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:28 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:29.077401 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-ebf53dec-fa22-4182-90f2-a5b6434c24ad tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:29.078341 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-ebf53dec-fa22-4182-90f2-a5b6434c24ad tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:29.084498 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ebf53dec-fa22-4182-90f2-a5b6434c24ad tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:29.084958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ebf53dec-fa22-4182-90f2-a5b6434c24ad tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:29.085716 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ebf53dec-fa22-4182-90f2-a5b6434c24ad tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:29.086152 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ebf53dec-fa22-4182-90f2-a5b6434c24ad tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:29.099423 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-ebf53dec-fa22-4182-90f2-a5b6434c24ad tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] HTTP exception thrown: Instance 5540f679-ef89-453b-91c5-b11dacd977bd could not be found. Jun 27 09:37:29.101288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-ebf53dec-fa22-4182-90f2-a5b6434c24ad tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Request method failure captured: Jun 27 09:37:29.101288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd/os-volume_attachments HTTP/1.1 Jun 27 09:37:29.101288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:37:29.101288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:37:29.101288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:37:29.101288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:37:29.101288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:37:29.101288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:37:29.101288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:37:29.101288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:37:29.101288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXoPicHp459U66xm3i41NtzftGp_Wf0fiQ5zAZDB54eLIMYbXs8zSPmmdiycQw_YwQCZv86oUsfMem1FmmkDPXBbwZt6hajG7jDktx3MI4Hk5PWMAraLBhDAwp8HVH3n9BqU0cpZ6HixN6-7QLtDB_UX0egncFtO6OtqR6143k3jDwc Jun 27 09:37:29.101288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:37:29.101288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:37:29.101288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:37:29.101288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:37:29.101288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:37:29.101288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:37:29.101288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: 84dd698260134176acd4f4892911ab05 Jun 27 09:37:29.101288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-DeleteServersTestJSON-576591190 Jun 27 09:37:29.101288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:37:29.101288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:37:29.102702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/84dd698260134176acd4f4892911ab05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/84dd698260134176acd4f4892911ab05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/84dd698260134176acd4f4892911ab05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_84dd698260134176acd4f4892911ab05", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:37:29.102702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-DeleteServersTestJSON-576591190 Jun 27 09:37:29.102702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: 84dd698260134176acd4f4892911ab05 Jun 27 09:37:29.102702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-DeleteServersTestJSON-576591190 Jun 27 09:37:29.102702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-DeleteServersTestJSON-576591190-project Jun 27 09:37:29.102702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:37:29.102702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:37:29.102702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: 9b5d5a3f43c544368118125f2e194565 Jun 27 09:37:29.102702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-DeleteServersTestJSON-576591190-project Jun 27 09:37:29.102702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: > Jun 27 09:37:29.102702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Instance 5540f679-ef89-453b-91c5-b11dacd977bd could not be found. Jun 27 09:37:29.102702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'server_id': '5540f679-ef89-453b-91c5-b11dacd977bd'} Jun 27 09:37:29.103592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:37:29.103592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:37:29.103592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:37:29.103592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:37:29.103592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:37:29.103592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:37:29.103592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:37:29.103592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:37:29.103592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:37:29.103592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:37:29.103592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5540f679-ef89-453b-91c5-b11dacd977bd could not be found. Jun 27 09:37:29.103592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:37:29.103592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:37:29.103592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:37:29.103592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:37:29.103592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:37:29.103592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:37:29.103592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:37:29.103592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:37:29.103592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:37:29.104630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:37:29.104630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 27 09:37:29.104630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 09:37:29.104630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 27 09:37:29.104630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 09:37:29.104630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 27 09:37:29.104630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 27 09:37:29.104630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:37:29.104630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:37:29.104630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5540f679-ef89-453b-91c5-b11dacd977bd could not be found. Jun 27 09:37:29.104630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:37:29.104630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:37:29.104630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:37:29.104630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:37:29.104630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:37:29.104630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:37:29.104630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:37:29.104630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:37:29.104630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5540f679-ef89-453b-91c5-b11dacd977bd could not be found. Jun 27 09:37:29.104630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:37:29.105800 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-ebf53dec-fa22-4182-90f2-a5b6434c24ad tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Returning 404 to user: Instance 5540f679-ef89-453b-91c5-b11dacd977bd could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:37:29.105800 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-ebf53dec-fa22-4182-90f2-a5b6434c24ad tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029225 Jun 27 09:37:29.105800 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 95/186] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 27 09:37:29 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:37:29.904264 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e6326854-fad8-4ccd-b5ae-310dcf59bb99 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:29.904975 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e6326854-fad8-4ccd-b5ae-310dcf59bb99 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:29.911566 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e6326854-fad8-4ccd-b5ae-310dcf59bb99 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:29.912012 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e6326854-fad8-4ccd-b5ae-310dcf59bb99 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:29.913358 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e6326854-fad8-4ccd-b5ae-310dcf59bb99 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:29.913799 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e6326854-fad8-4ccd-b5ae-310dcf59bb99 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:30.051924 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-e6326854-fad8-4ccd-b5ae-310dcf59bb99 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:30.062097 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e6326854-fad8-4ccd-b5ae-310dcf59bb99 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.162069 Jun 27 09:37:30.062908 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 92/187] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:29 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:30.799831 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-47242f90-574d-4e6a-b418-ac0b268c6dc5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:30.800426 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-47242f90-574d-4e6a-b418-ac0b268c6dc5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:30.809736 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-47242f90-574d-4e6a-b418-ac0b268c6dc5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:30.810289 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-47242f90-574d-4e6a-b418-ac0b268c6dc5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:30.811240 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-47242f90-574d-4e6a-b418-ac0b268c6dc5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:30.811900 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-47242f90-574d-4e6a-b418-ac0b268c6dc5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:30.827960 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-47242f90-574d-4e6a-b418-ac0b268c6dc5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] HTTP exception thrown: Instance 5540f679-ef89-453b-91c5-b11dacd977bd could not be found. Jun 27 09:37:30.829571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-47242f90-574d-4e6a-b418-ac0b268c6dc5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Request method failure captured: Jun 27 09:37:30.829571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: DELETE /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd HTTP/1.1 Jun 27 09:37:30.829571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:37:30.829571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:37:30.829571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:37:30.829571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:37:30.829571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:37:30.829571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:37:30.829571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:37:30.829571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:37:30.829571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXoPicHp459U66xm3i41NtzftGp_Wf0fiQ5zAZDB54eLIMYbXs8zSPmmdiycQw_YwQCZv86oUsfMem1FmmkDPXBbwZt6hajG7jDktx3MI4Hk5PWMAraLBhDAwp8HVH3n9BqU0cpZ6HixN6-7QLtDB_UX0egncFtO6OtqR6143k3jDwc Jun 27 09:37:30.829571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:37:30.829571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:37:30.829571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:37:30.829571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:37:30.829571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:37:30.829571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:37:30.829571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: 84dd698260134176acd4f4892911ab05 Jun 27 09:37:30.829571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-DeleteServersTestJSON-576591190 Jun 27 09:37:30.829571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:37:30.829571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:37:30.831028 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/84dd698260134176acd4f4892911ab05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/84dd698260134176acd4f4892911ab05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/84dd698260134176acd4f4892911ab05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_84dd698260134176acd4f4892911ab05", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:37:30.831028 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-DeleteServersTestJSON-576591190 Jun 27 09:37:30.831028 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: 84dd698260134176acd4f4892911ab05 Jun 27 09:37:30.831028 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-DeleteServersTestJSON-576591190 Jun 27 09:37:30.831028 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-DeleteServersTestJSON-576591190-project Jun 27 09:37:30.831028 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:37:30.831028 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:37:30.831028 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: 9b5d5a3f43c544368118125f2e194565 Jun 27 09:37:30.831028 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-DeleteServersTestJSON-576591190-project Jun 27 09:37:30.831028 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: > Jun 27 09:37:30.831028 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Instance 5540f679-ef89-453b-91c5-b11dacd977bd could not be found. Jun 27 09:37:30.831028 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'id': '5540f679-ef89-453b-91c5-b11dacd977bd'} Jun 27 09:37:30.831889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:37:30.831889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:37:30.831889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:37:30.831889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:37:30.831889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:37:30.831889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:37:30.831889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:37:30.831889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:37:30.831889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:37:30.831889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:37:30.831889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5540f679-ef89-453b-91c5-b11dacd977bd could not be found. Jun 27 09:37:30.831889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:37:30.831889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:37:30.831889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:37:30.831889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:37:30.831889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:37:30.831889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:37:30.831889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:37:30.831889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:37:30.831889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:37:30.833214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:37:30.833214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 09:37:30.833214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 09:37:30.833214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 09:37:30.833214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 09:37:30.833214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:37:30.833214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:37:30.833214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:37:30.833214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:37:30.833214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5540f679-ef89-453b-91c5-b11dacd977bd could not be found. Jun 27 09:37:30.833214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:37:30.833214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:37:30.833214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:37:30.833214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:37:30.833214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:37:30.833214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:37:30.833214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:37:30.833214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:37:30.833214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5540f679-ef89-453b-91c5-b11dacd977bd could not be found. Jun 27 09:37:30.833214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:37:30.834500 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-47242f90-574d-4e6a-b418-ac0b268c6dc5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Returning 404 to user: Instance 5540f679-ef89-453b-91c5-b11dacd977bd could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:37:30.834500 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-47242f90-574d-4e6a-b418-ac0b268c6dc5 tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 404 len: 111 microversion: 2.1 time: 0.036796 Jun 27 09:37:30.834500 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 96/188] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:37:30 2022] DELETE /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:37:30.841929 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-d2df8ec0-d600-41ee-8a3a-1bb409ce649a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:30.842544 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-d2df8ec0-d600-41ee-8a3a-1bb409ce649a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] [instance: 5540f679-ef89-453b-91c5-b11dacd977bd] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:30.849227 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d2df8ec0-d600-41ee-8a3a-1bb409ce649a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:30.849682 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d2df8ec0-d600-41ee-8a3a-1bb409ce649a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:30.850473 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d2df8ec0-d600-41ee-8a3a-1bb409ce649a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:30.851440 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d2df8ec0-d600-41ee-8a3a-1bb409ce649a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:30.864447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-d2df8ec0-d600-41ee-8a3a-1bb409ce649a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] HTTP exception thrown: Instance 5540f679-ef89-453b-91c5-b11dacd977bd could not be found. Jun 27 09:37:30.869692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-d2df8ec0-d600-41ee-8a3a-1bb409ce649a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Request method failure captured: Jun 27 09:37:30.869692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd HTTP/1.1 Jun 27 09:37:30.869692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:37:30.869692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:37:30.869692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:37:30.869692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:37:30.869692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:37:30.869692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:37:30.869692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:37:30.869692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:37:30.869692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXoPicHp459U66xm3i41NtzftGp_Wf0fiQ5zAZDB54eLIMYbXs8zSPmmdiycQw_YwQCZv86oUsfMem1FmmkDPXBbwZt6hajG7jDktx3MI4Hk5PWMAraLBhDAwp8HVH3n9BqU0cpZ6HixN6-7QLtDB_UX0egncFtO6OtqR6143k3jDwc Jun 27 09:37:30.869692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:37:30.869692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:37:30.869692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:37:30.869692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:37:30.869692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:37:30.869692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:37:30.869692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: 84dd698260134176acd4f4892911ab05 Jun 27 09:37:30.869692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-DeleteServersTestJSON-576591190 Jun 27 09:37:30.869692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:37:30.869692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:37:30.871175 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/84dd698260134176acd4f4892911ab05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/84dd698260134176acd4f4892911ab05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/84dd698260134176acd4f4892911ab05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_84dd698260134176acd4f4892911ab05", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:37:30.871175 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-DeleteServersTestJSON-576591190 Jun 27 09:37:30.871175 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: 84dd698260134176acd4f4892911ab05 Jun 27 09:37:30.871175 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-DeleteServersTestJSON-576591190 Jun 27 09:37:30.871175 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-DeleteServersTestJSON-576591190-project Jun 27 09:37:30.871175 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:37:30.871175 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:37:30.871175 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: 9b5d5a3f43c544368118125f2e194565 Jun 27 09:37:30.871175 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-DeleteServersTestJSON-576591190-project Jun 27 09:37:30.871175 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: > Jun 27 09:37:30.871175 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Instance 5540f679-ef89-453b-91c5-b11dacd977bd could not be found. Jun 27 09:37:30.871175 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': '5540f679-ef89-453b-91c5-b11dacd977bd'} Jun 27 09:37:30.872047 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:37:30.872047 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:37:30.872047 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:37:30.872047 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:37:30.872047 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:37:30.872047 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:37:30.872047 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:37:30.872047 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:37:30.872047 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:37:30.872047 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:37:30.872047 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5540f679-ef89-453b-91c5-b11dacd977bd could not be found. Jun 27 09:37:30.872047 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:37:30.872047 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:37:30.872047 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:37:30.872047 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:37:30.872047 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:37:30.872047 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:37:30.872047 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:37:30.872047 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:37:30.872047 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:37:30.873439 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:37:30.873439 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:37:30.873439 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:37:30.873439 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:37:30.873439 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:37:30.873439 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:37:30.873439 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:37:30.873439 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5540f679-ef89-453b-91c5-b11dacd977bd could not be found. Jun 27 09:37:30.873439 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:37:30.873439 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:37:30.873439 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:37:30.873439 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:37:30.873439 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:37:30.873439 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:37:30.873439 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:37:30.873439 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:37:30.873439 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5540f679-ef89-453b-91c5-b11dacd977bd could not be found. Jun 27 09:37:30.873439 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:37:30.874670 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-d2df8ec0-d600-41ee-8a3a-1bb409ce649a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] Returning 404 to user: Instance 5540f679-ef89-453b-91c5-b11dacd977bd could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:37:30.874670 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-d2df8ec0-d600-41ee-8a3a-1bb409ce649a tempest-DeleteServersTestJSON-576591190 tempest-DeleteServersTestJSON-576591190-project] 10.222.0.64 "GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd" status: 404 len: 111 microversion: 2.1 time: 0.033116 Jun 27 09:37:30.875099 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 93/189] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:30 2022] GET /compute/v2.1/servers/5540f679-ef89-453b-91c5-b11dacd977bd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:37:31.079350 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-475cdfff-9a86-46a6-8819-768bc03cadef tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:31.079979 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-475cdfff-9a86-46a6-8819-768bc03cadef tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:31.086317 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-475cdfff-9a86-46a6-8819-768bc03cadef tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:31.086763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-475cdfff-9a86-46a6-8819-768bc03cadef tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:31.087560 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-475cdfff-9a86-46a6-8819-768bc03cadef tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:31.087947 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-475cdfff-9a86-46a6-8819-768bc03cadef tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:31.230809 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-475cdfff-9a86-46a6-8819-768bc03cadef tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:31.238312 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-475cdfff-9a86-46a6-8819-768bc03cadef tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.162861 Jun 27 09:37:31.238876 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 97/190] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:31 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:32.254231 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-023e47a6-3050-48fd-9ef5-80d72a089d63 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:32.255015 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-023e47a6-3050-48fd-9ef5-80d72a089d63 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:32.262463 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-023e47a6-3050-48fd-9ef5-80d72a089d63 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:32.262912 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-023e47a6-3050-48fd-9ef5-80d72a089d63 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:32.263724 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-023e47a6-3050-48fd-9ef5-80d72a089d63 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:32.264266 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-023e47a6-3050-48fd-9ef5-80d72a089d63 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:32.537320 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-023e47a6-3050-48fd-9ef5-80d72a089d63 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:32.545647 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-023e47a6-3050-48fd-9ef5-80d72a089d63 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.295326 Jun 27 09:37:32.546214 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 94/191] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:32 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:33.562398 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-1f64610c-3a6a-44d5-bc2d-048a9a224db0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:33.563673 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-1f64610c-3a6a-44d5-bc2d-048a9a224db0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:33.573320 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1f64610c-3a6a-44d5-bc2d-048a9a224db0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:33.575781 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1f64610c-3a6a-44d5-bc2d-048a9a224db0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:33.576688 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1f64610c-3a6a-44d5-bc2d-048a9a224db0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:33.577201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1f64610c-3a6a-44d5-bc2d-048a9a224db0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:33.739403 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-1f64610c-3a6a-44d5-bc2d-048a9a224db0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:33.749253 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-1f64610c-3a6a-44d5-bc2d-048a9a224db0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.190645 Jun 27 09:37:33.750024 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 98/192] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:33 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:34.766107 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-99ff2722-9a5d-45e7-abfc-fac9074b2bcb tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:34.766644 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-99ff2722-9a5d-45e7-abfc-fac9074b2bcb tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:34.774643 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-99ff2722-9a5d-45e7-abfc-fac9074b2bcb tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:34.775150 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-99ff2722-9a5d-45e7-abfc-fac9074b2bcb tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:34.775969 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-99ff2722-9a5d-45e7-abfc-fac9074b2bcb tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:34.776453 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-99ff2722-9a5d-45e7-abfc-fac9074b2bcb tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:34.951571 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-99ff2722-9a5d-45e7-abfc-fac9074b2bcb tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:34.964362 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-99ff2722-9a5d-45e7-abfc-fac9074b2bcb tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.201267 Jun 27 09:37:34.965903 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 95/193] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:34 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:35.983049 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-b7a320c4-315e-4e63-91a8-cca7cdc4effb tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:35.983694 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-b7a320c4-315e-4e63-91a8-cca7cdc4effb tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:35.990583 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b7a320c4-315e-4e63-91a8-cca7cdc4effb tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:35.994299 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b7a320c4-315e-4e63-91a8-cca7cdc4effb tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:35.995238 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b7a320c4-315e-4e63-91a8-cca7cdc4effb tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:35.995722 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b7a320c4-315e-4e63-91a8-cca7cdc4effb tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:36.145776 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-b7a320c4-315e-4e63-91a8-cca7cdc4effb tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:36.155990 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-b7a320c4-315e-4e63-91a8-cca7cdc4effb tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.177205 Jun 27 09:37:36.156570 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 99/194] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:35 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:37.178117 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-28850a61-22dd-45c4-a60e-55d3ae8460de tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:37.179334 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-28850a61-22dd-45c4-a60e-55d3ae8460de tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:37.183768 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=42 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:37.187873 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-28850a61-22dd-45c4-a60e-55d3ae8460de tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:37.188555 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-28850a61-22dd-45c4-a60e-55d3ae8460de tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:37.189329 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-28850a61-22dd-45c4-a60e-55d3ae8460de tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:37.189921 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-28850a61-22dd-45c4-a60e-55d3ae8460de tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:37.385606 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-28850a61-22dd-45c4-a60e-55d3ae8460de tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:37.393292 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-28850a61-22dd-45c4-a60e-55d3ae8460de tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.223087 Jun 27 09:37:37.393872 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 96/195] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:37 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:38.410458 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-2638da57-5e67-4885-9492-8de83aa96e78 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:38.411009 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-2638da57-5e67-4885-9492-8de83aa96e78 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:38.417838 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2638da57-5e67-4885-9492-8de83aa96e78 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:38.418293 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2638da57-5e67-4885-9492-8de83aa96e78 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:38.419270 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2638da57-5e67-4885-9492-8de83aa96e78 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:38.419891 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2638da57-5e67-4885-9492-8de83aa96e78 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:38.704716 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2638da57-5e67-4885-9492-8de83aa96e78 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:38.713433 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-2638da57-5e67-4885-9492-8de83aa96e78 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.307131 Jun 27 09:37:38.714050 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 100/196] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:38 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:39.738316 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-7e37050a-c020-4a97-beea-3eb479f1eb07 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:39.739719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-7e37050a-c020-4a97-beea-3eb479f1eb07 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:39.752356 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7e37050a-c020-4a97-beea-3eb479f1eb07 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:39.753007 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7e37050a-c020-4a97-beea-3eb479f1eb07 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:39.754118 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7e37050a-c020-4a97-beea-3eb479f1eb07 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:39.755004 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7e37050a-c020-4a97-beea-3eb479f1eb07 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:39.992986 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-7e37050a-c020-4a97-beea-3eb479f1eb07 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:40.002251 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-7e37050a-c020-4a97-beea-3eb479f1eb07 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.272280 Jun 27 09:37:40.003154 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 97/197] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:39 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:41.028192 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f259e2aa-e004-41c3-a152-b0c2727adeb1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:41.029641 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-f259e2aa-e004-41c3-a152-b0c2727adeb1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:41.037791 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f259e2aa-e004-41c3-a152-b0c2727adeb1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:41.038600 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f259e2aa-e004-41c3-a152-b0c2727adeb1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:41.040035 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f259e2aa-e004-41c3-a152-b0c2727adeb1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:41.041012 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f259e2aa-e004-41c3-a152-b0c2727adeb1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:41.196779 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f259e2aa-e004-41c3-a152-b0c2727adeb1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:41.204376 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-f259e2aa-e004-41c3-a152-b0c2727adeb1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.188282 Jun 27 09:37:41.208517 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 101/198] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:41 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:42.223139 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-84c485da-deb9-458f-8586-55a2f4351e03 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:42.230238 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-84c485da-deb9-458f-8586-55a2f4351e03 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:42.230874 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-84c485da-deb9-458f-8586-55a2f4351e03 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:42.232470 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-84c485da-deb9-458f-8586-55a2f4351e03 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:42.233418 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-84c485da-deb9-458f-8586-55a2f4351e03 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:42.234124 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-84c485da-deb9-458f-8586-55a2f4351e03 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:42.467779 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-84c485da-deb9-458f-8586-55a2f4351e03 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:42.475561 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-84c485da-deb9-458f-8586-55a2f4351e03 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.257206 Jun 27 09:37:42.476175 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 98/199] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:42 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:43.493383 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-d33420e3-d22a-414a-9f4f-44f4213af5d6 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:43.494149 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-d33420e3-d22a-414a-9f4f-44f4213af5d6 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:43.501795 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d33420e3-d22a-414a-9f4f-44f4213af5d6 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:43.502338 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d33420e3-d22a-414a-9f4f-44f4213af5d6 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:43.503194 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d33420e3-d22a-414a-9f4f-44f4213af5d6 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:43.503768 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d33420e3-d22a-414a-9f4f-44f4213af5d6 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:43.673269 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d33420e3-d22a-414a-9f4f-44f4213af5d6 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:43.685101 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-d33420e3-d22a-414a-9f4f-44f4213af5d6 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.196087 Jun 27 09:37:43.686219 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 99/200] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:43 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:37:43.781939 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-35ad6769-be97-4044-b3aa-9c4de88a4ebc tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Action: 'create', calling method: .version_select at 0x7ffa9c0c4310>, body: {"keypair": {"name": "tempest-keypair-920107729", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhePmbpi9OqyloFAglJnW3hYBIuk395sxh/0c5raQaKzGMKw25ItzuItatkmY3Ulwx4ypo5tIwtZarOriOphh9EzuViVRT8kK3YPhpgCQZ7GBYYvBLjm0iDbjJUCEjm4w=="}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:37:43.809303 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-35ad6769-be97-4044-b3aa-9c4de88a4ebc tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Getting quotas for project 4b698ead017b4ef8b397ee127b487309. Resources: {'key_pairs'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:37:43.813477 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-35ad6769-be97-4044-b3aa-9c4de88a4ebc tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Getting quotas for user cc8a087e97424d2890952be33695378f and project 4b698ead017b4ef8b397ee127b487309. Resources: {'key_pairs'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:37:43.938341 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-35ad6769-be97-4044-b3aa-9c4de88a4ebc tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.477350 Jun 27 09:37:43.939254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 102/201] 10.222.0.64 () {60 vars in 1158 bytes} [Mon Jun 27 09:37:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:37:44.702719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-0d074926-2524-4590-ba3b-c9d5cc2dca69 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:44.707354 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-0d074926-2524-4590-ba3b-c9d5cc2dca69 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:44.728591 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0d074926-2524-4590-ba3b-c9d5cc2dca69 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:44.729371 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0d074926-2524-4590-ba3b-c9d5cc2dca69 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:44.730375 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0d074926-2524-4590-ba3b-c9d5cc2dca69 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:44.730954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0d074926-2524-4590-ba3b-c9d5cc2dca69 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:44.901587 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-0d074926-2524-4590-ba3b-c9d5cc2dca69 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:44.906383 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-0d074926-2524-4590-ba3b-c9d5cc2dca69 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.207426 Jun 27 09:37:44.906983 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 100/202] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:44 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:45.924404 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-47ece548-f396-4d8c-9dbc-6ad6cc8f4790 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:45.925117 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-47ece548-f396-4d8c-9dbc-6ad6cc8f4790 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:45.927139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:45.955950 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-47ece548-f396-4d8c-9dbc-6ad6cc8f4790 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:45.956457 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-47ece548-f396-4d8c-9dbc-6ad6cc8f4790 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:45.959228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-47ece548-f396-4d8c-9dbc-6ad6cc8f4790 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:45.963491 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-47ece548-f396-4d8c-9dbc-6ad6cc8f4790 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:46.317506 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-47ece548-f396-4d8c-9dbc-6ad6cc8f4790 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:46.326921 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-47ece548-f396-4d8c-9dbc-6ad6cc8f4790 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.407264 Jun 27 09:37:46.327502 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 103/203] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:45 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:47.033935 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-115d0482-b4ae-4e4b-aa1b-31f43388016c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1069566661", "imageRef": "96dfa32c-d52f-4225-8918-743ebc97f4bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "44332445-ecaa-4205-9b0a-eb56bcdc88ee"}], "security_groups": [{"name": "tempest-securitygroup--618470302"}], "key_name": "tempest-keypair-920107729", "user_data": "}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:37:47.255330 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.network.neutron [None req-115d0482-b4ae-4e4b-aa1b-31f43388016c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] validate_networks() for [('44332445-ecaa-4205-9b0a-eb56bcdc88ee', None, None, None, None, None)] {{(pid=124870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 09:37:47.345185 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-ca0698f2-a10b-4750-a7a3-aa0e42f4cafc tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:47.349340 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-ca0698f2-a10b-4750-a7a3-aa0e42f4cafc tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:47.360422 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ca0698f2-a10b-4750-a7a3-aa0e42f4cafc tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:47.361529 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ca0698f2-a10b-4750-a7a3-aa0e42f4cafc tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:47.364400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ca0698f2-a10b-4750-a7a3-aa0e42f4cafc tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:47.364926 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ca0698f2-a10b-4750-a7a3-aa0e42f4cafc tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:47.729109 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-ca0698f2-a10b-4750-a7a3-aa0e42f4cafc tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:47.741692 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-ca0698f2-a10b-4750-a7a3-aa0e42f4cafc tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.401327 Jun 27 09:37:47.744038 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 104/204] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:47 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:47.843521 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-115d0482-b4ae-4e4b-aa1b-31f43388016c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Flavor limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 09:37:47.844131 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-115d0482-b4ae-4e4b-aa1b-31f43388016c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Image limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 09:37:47.844606 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-115d0482-b4ae-4e4b-aa1b-31f43388016c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Flavor pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 09:37:47.845264 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-115d0482-b4ae-4e4b-aa1b-31f43388016c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Image pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 09:37:47.845681 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-115d0482-b4ae-4e4b-aa1b-31f43388016c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 09:37:47.863373 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-115d0482-b4ae-4e4b-aa1b-31f43388016c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:47.864178 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-115d0482-b4ae-4e4b-aa1b-31f43388016c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:47.868363 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-115d0482-b4ae-4e4b-aa1b-31f43388016c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:47.869059 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-115d0482-b4ae-4e4b-aa1b-31f43388016c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:47.895239 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-115d0482-b4ae-4e4b-aa1b-31f43388016c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Getting quotas for project 4b698ead017b4ef8b397ee127b487309. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:37:47.902825 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-115d0482-b4ae-4e4b-aa1b-31f43388016c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Getting quotas for user cc8a087e97424d2890952be33695378f and project 4b698ead017b4ef8b397ee127b487309. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:37:47.916267 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-115d0482-b4ae-4e4b-aa1b-31f43388016c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Going to run 1 instances... {{(pid=124870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 09:37:47.918805 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-115d0482-b4ae-4e4b-aa1b-31f43388016c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96dfa32c-d52f-4225-8918-743ebc97f4bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 09:37:48.076924 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-115d0482-b4ae-4e4b-aa1b-31f43388016c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.047779 Jun 27 09:37:48.079440 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 101/205] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 27 09:37:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 09:37:48.090546 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-41cc30e0-d856-4ce3-9465-f6766ef0d0c0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:48.091508 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-41cc30e0-d856-4ce3-9465-f6766ef0d0c0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:48.169295 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-41cc30e0-d856-4ce3-9465-f6766ef0d0c0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:48.178298 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-41cc30e0-d856-4ce3-9465-f6766ef0d0c0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1241 microversion: 2.1 time: 0.091622 Jun 27 09:37:48.178992 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 105/206] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:48 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:48.760796 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-9901ef8b-dc30-4986-b713-3e756122d42c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:48.771148 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-9901ef8b-dc30-4986-b713-3e756122d42c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:48.771148 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9901ef8b-dc30-4986-b713-3e756122d42c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:48.771148 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9901ef8b-dc30-4986-b713-3e756122d42c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:48.771148 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9901ef8b-dc30-4986-b713-3e756122d42c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:48.772846 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9901ef8b-dc30-4986-b713-3e756122d42c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:48.931904 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-9901ef8b-dc30-4986-b713-3e756122d42c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:48.949013 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-9901ef8b-dc30-4986-b713-3e756122d42c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.192179 Jun 27 09:37:48.958582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 102/207] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:48 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:37:49.195692 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-cb9165da-75cc-47ed-bfe2-3f4bd5964c25 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:49.196367 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-cb9165da-75cc-47ed-bfe2-3f4bd5964c25 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:49.272863 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-cb9165da-75cc-47ed-bfe2-3f4bd5964c25 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:49.281922 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-cb9165da-75cc-47ed-bfe2-3f4bd5964c25 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1241 microversion: 2.1 time: 0.090636 Jun 27 09:37:49.282543 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 106/208] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:49 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:49.969239 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e02939cf-9e50-4fe2-963c-ee2582411810 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:49.969239 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e02939cf-9e50-4fe2-963c-ee2582411810 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:49.976390 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e02939cf-9e50-4fe2-963c-ee2582411810 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:49.976877 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e02939cf-9e50-4fe2-963c-ee2582411810 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:49.977733 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e02939cf-9e50-4fe2-963c-ee2582411810 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:49.978281 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e02939cf-9e50-4fe2-963c-ee2582411810 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:50.137994 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-e02939cf-9e50-4fe2-963c-ee2582411810 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:50.148148 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e02939cf-9e50-4fe2-963c-ee2582411810 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.184574 Jun 27 09:37:50.149192 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 103/209] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:49 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:50.302817 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-b12f563f-1577-4bcb-b298-8def3d3eeaab tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:50.303463 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-b12f563f-1577-4bcb-b298-8def3d3eeaab tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:50.309856 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b12f563f-1577-4bcb-b298-8def3d3eeaab tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:50.310308 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b12f563f-1577-4bcb-b298-8def3d3eeaab tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:50.311080 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b12f563f-1577-4bcb-b298-8def3d3eeaab tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:50.311630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b12f563f-1577-4bcb-b298-8def3d3eeaab tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:50.385378 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-b12f563f-1577-4bcb-b298-8def3d3eeaab tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:50.393857 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-b12f563f-1577-4bcb-b298-8def3d3eeaab tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1237 microversion: 2.1 time: 0.094772 Jun 27 09:37:50.394941 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 107/210] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:50 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1237 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:51.168656 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-96dc4c19-09ee-46b4-8b37-7c9aa41370bf tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:51.170359 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-96dc4c19-09ee-46b4-8b37-7c9aa41370bf tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:51.180492 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-96dc4c19-09ee-46b4-8b37-7c9aa41370bf tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:51.181500 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-96dc4c19-09ee-46b4-8b37-7c9aa41370bf tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:51.183427 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-96dc4c19-09ee-46b4-8b37-7c9aa41370bf tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:51.184055 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-96dc4c19-09ee-46b4-8b37-7c9aa41370bf tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:51.412307 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e5ca0c72-c1fe-4691-88ca-711c3e017c36 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:51.413516 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-e5ca0c72-c1fe-4691-88ca-711c3e017c36 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:51.422748 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e5ca0c72-c1fe-4691-88ca-711c3e017c36 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:51.423354 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e5ca0c72-c1fe-4691-88ca-711c3e017c36 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:51.424091 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e5ca0c72-c1fe-4691-88ca-711c3e017c36 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:51.425186 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e5ca0c72-c1fe-4691-88ca-711c3e017c36 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:51.433432 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-96dc4c19-09ee-46b4-8b37-7c9aa41370bf tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:51.453420 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-96dc4c19-09ee-46b4-8b37-7c9aa41370bf tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.290609 Jun 27 09:37:51.454315 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 104/211] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:51 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:51.532291 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e5ca0c72-c1fe-4691-88ca-711c3e017c36 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:51.540972 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-e5ca0c72-c1fe-4691-88ca-711c3e017c36 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1237 microversion: 2.1 time: 0.133756 Jun 27 09:37:51.550604 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 108/212] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:51 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1237 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:52.471560 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-bd33e7c9-8619-4a71-ad6e-2c647bc1fd5b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:52.472173 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-bd33e7c9-8619-4a71-ad6e-2c647bc1fd5b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:52.483637 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-bd33e7c9-8619-4a71-ad6e-2c647bc1fd5b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:52.484108 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-bd33e7c9-8619-4a71-ad6e-2c647bc1fd5b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:52.484889 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-bd33e7c9-8619-4a71-ad6e-2c647bc1fd5b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:52.485330 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-bd33e7c9-8619-4a71-ad6e-2c647bc1fd5b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:52.558426 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-d6b49062-272c-4fb0-ac34-f27838124b21 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:52.559040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-d6b49062-272c-4fb0-ac34-f27838124b21 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:52.565667 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d6b49062-272c-4fb0-ac34-f27838124b21 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:52.566124 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d6b49062-272c-4fb0-ac34-f27838124b21 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:52.566935 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d6b49062-272c-4fb0-ac34-f27838124b21 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:52.567379 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d6b49062-272c-4fb0-ac34-f27838124b21 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:52.651906 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-d6b49062-272c-4fb0-ac34-f27838124b21 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:52.660073 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-d6b49062-272c-4fb0-ac34-f27838124b21 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1237 microversion: 2.1 time: 0.106307 Jun 27 09:37:52.660675 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 109/213] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:52 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1237 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:52.745113 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-bd33e7c9-8619-4a71-ad6e-2c647bc1fd5b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:52.765299 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-bd33e7c9-8619-4a71-ad6e-2c647bc1fd5b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.296765 Jun 27 09:37:52.766542 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 105/214] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:52 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:53.680769 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-edc4d1d7-0f99-47b6-ac9a-d8f04183a12c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:53.681538 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-edc4d1d7-0f99-47b6-ac9a-d8f04183a12c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:53.691291 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-edc4d1d7-0f99-47b6-ac9a-d8f04183a12c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:53.691950 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-edc4d1d7-0f99-47b6-ac9a-d8f04183a12c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:53.692924 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-edc4d1d7-0f99-47b6-ac9a-d8f04183a12c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:53.696139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-edc4d1d7-0f99-47b6-ac9a-d8f04183a12c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:53.762232 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-edc4d1d7-0f99-47b6-ac9a-d8f04183a12c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:53.770298 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-edc4d1d7-0f99-47b6-ac9a-d8f04183a12c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1301 microversion: 2.1 time: 0.093627 Jun 27 09:37:53.770999 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 110/215] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:53 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1301 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:53.786000 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-0162991d-fa76-4113-a4f5-8466b15f7d97 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:53.788263 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-0162991d-fa76-4113-a4f5-8466b15f7d97 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:53.808016 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0162991d-fa76-4113-a4f5-8466b15f7d97 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:53.808701 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0162991d-fa76-4113-a4f5-8466b15f7d97 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:53.809607 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0162991d-fa76-4113-a4f5-8466b15f7d97 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:53.810110 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0162991d-fa76-4113-a4f5-8466b15f7d97 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:53.982573 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-0162991d-fa76-4113-a4f5-8466b15f7d97 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:53.990101 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-0162991d-fa76-4113-a4f5-8466b15f7d97 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1522 microversion: 2.1 time: 0.208987 Jun 27 09:37:53.999911 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 106/216] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:53 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:54.794660 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-8924d5b2-efa5-4933-aba2-38ac0ece79da tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:54.795670 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-8924d5b2-efa5-4933-aba2-38ac0ece79da tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:54.805135 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8924d5b2-efa5-4933-aba2-38ac0ece79da tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:54.809323 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8924d5b2-efa5-4933-aba2-38ac0ece79da tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:54.810134 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8924d5b2-efa5-4933-aba2-38ac0ece79da tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:54.810578 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8924d5b2-efa5-4933-aba2-38ac0ece79da tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:55.007618 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-0712ea03-d16f-473d-848e-13c69b137404 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:55.008246 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-0712ea03-d16f-473d-848e-13c69b137404 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:55.016422 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0712ea03-d16f-473d-848e-13c69b137404 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:55.016926 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0712ea03-d16f-473d-848e-13c69b137404 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:55.017979 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0712ea03-d16f-473d-848e-13c69b137404 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:55.018490 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0712ea03-d16f-473d-848e-13c69b137404 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:55.133107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-8924d5b2-efa5-4933-aba2-38ac0ece79da tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:55.151214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-8924d5b2-efa5-4933-aba2-38ac0ece79da tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1366 microversion: 2.1 time: 0.354812 Jun 27 09:37:55.152057 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 111/217] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:54 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:55.410659 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-0712ea03-d16f-473d-848e-13c69b137404 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:55.424160 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-0712ea03-d16f-473d-848e-13c69b137404 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1502 microversion: 2.1 time: 0.420848 Jun 27 09:37:55.441093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 107/218] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:55 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1502 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:37:55.464274 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-470ae542-d808-471b-bfc7-29d4368fa3e0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:55.464904 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-470ae542-d808-471b-bfc7-29d4368fa3e0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:55.490117 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-470ae542-d808-471b-bfc7-29d4368fa3e0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:55.492050 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-470ae542-d808-471b-bfc7-29d4368fa3e0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:55.492844 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-470ae542-d808-471b-bfc7-29d4368fa3e0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:55.493296 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-470ae542-d808-471b-bfc7-29d4368fa3e0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:55.762885 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-470ae542-d808-471b-bfc7-29d4368fa3e0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:55.770613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-470ae542-d808-471b-bfc7-29d4368fa3e0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1515 microversion: 2.1 time: 0.314256 Jun 27 09:37:55.771198 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 112/219] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:55 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1515 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:55.846032 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-ebeb5d0d-7750-482e-acc0-3e5b381bc316 req-3fe9d00d-5336-48ac-9087-9256cccf47ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dd479f3-f038-498f-b06d-c47cc1e8bfa2", "tag": "95a7b7da-b0e9-4bbd-9924-d201c61db4b4"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:37:55.860539 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-ebeb5d0d-7750-482e-acc0-3e5b381bc316 req-3fe9d00d-5336-48ac-9087-9256cccf47ec service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:55.861611 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-ebeb5d0d-7750-482e-acc0-3e5b381bc316 req-3fe9d00d-5336-48ac-9087-9256cccf47ec service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:55.878343 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-ebeb5d0d-7750-482e-acc0-3e5b381bc316 req-3fe9d00d-5336-48ac-9087-9256cccf47ec service nova] Creating event network-changed:95a7b7da-b0e9-4bbd-9924-d201c61db4b4 for instance 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 on hv-cinder-84773 Jun 27 09:37:55.884308 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-ebeb5d0d-7750-482e-acc0-3e5b381bc316 req-3fe9d00d-5336-48ac-9087-9256cccf47ec service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042252 Jun 27 09:37:55.884908 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 108/220] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:37:56.169523 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-acc17094-5597-4c7f-b0ea-64be8a2f5467 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:56.170154 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-acc17094-5597-4c7f-b0ea-64be8a2f5467 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:56.176211 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-acc17094-5597-4c7f-b0ea-64be8a2f5467 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:56.176658 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-acc17094-5597-4c7f-b0ea-64be8a2f5467 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:56.177418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-acc17094-5597-4c7f-b0ea-64be8a2f5467 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:56.177848 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-acc17094-5597-4c7f-b0ea-64be8a2f5467 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:56.329499 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-acc17094-5597-4c7f-b0ea-64be8a2f5467 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:56.331687 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=99 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:56.337929 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-acc17094-5597-4c7f-b0ea-64be8a2f5467 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1366 microversion: 2.1 time: 0.172205 Jun 27 09:37:56.338823 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 113/221] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:56 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:57.356685 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-dc5307e5-7f52-403b-95fd-a8cdfdc70b6c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:57.357943 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-dc5307e5-7f52-403b-95fd-a8cdfdc70b6c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:57.364760 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dc5307e5-7f52-403b-95fd-a8cdfdc70b6c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:57.365426 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dc5307e5-7f52-403b-95fd-a8cdfdc70b6c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:57.366860 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dc5307e5-7f52-403b-95fd-a8cdfdc70b6c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:57.367464 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dc5307e5-7f52-403b-95fd-a8cdfdc70b6c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:57.533184 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-dc5307e5-7f52-403b-95fd-a8cdfdc70b6c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:57.544262 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-dc5307e5-7f52-403b-95fd-a8cdfdc70b6c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1366 microversion: 2.1 time: 0.193657 Jun 27 09:37:57.548673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 109/222] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:57 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:58.565288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-3477e148-5138-44fc-8856-1c7c7de7cd79 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:58.567025 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-3477e148-5138-44fc-8856-1c7c7de7cd79 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:58.574151 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3477e148-5138-44fc-8856-1c7c7de7cd79 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:58.575767 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3477e148-5138-44fc-8856-1c7c7de7cd79 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:58.576559 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3477e148-5138-44fc-8856-1c7c7de7cd79 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:58.576997 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3477e148-5138-44fc-8856-1c7c7de7cd79 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:58.818102 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-3477e148-5138-44fc-8856-1c7c7de7cd79 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:37:58.828121 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-3477e148-5138-44fc-8856-1c7c7de7cd79 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1366 microversion: 2.1 time: 0.267645 Jun 27 09:37:58.828806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 114/223] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:58 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:37:59.845216 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-cd03ad9a-1e0c-48d6-a5d9-d057afeff0a8 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:37:59.845965 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-cd03ad9a-1e0c-48d6-a5d9-d057afeff0a8 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:37:59.848028 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=2 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:59.848684 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=6 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:37:59.854577 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cd03ad9a-1e0c-48d6-a5d9-d057afeff0a8 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:59.855372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cd03ad9a-1e0c-48d6-a5d9-d057afeff0a8 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:59.856580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cd03ad9a-1e0c-48d6-a5d9-d057afeff0a8 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:37:59.857193 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cd03ad9a-1e0c-48d6-a5d9-d057afeff0a8 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:37:59.887419 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=100 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:38:00.005511 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-cd03ad9a-1e0c-48d6-a5d9-d057afeff0a8 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:00.013698 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-cd03ad9a-1e0c-48d6-a5d9-d057afeff0a8 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1366 microversion: 2.1 time: 0.172459 Jun 27 09:38:00.016128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 110/224] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:37:59 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:00.180588 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e48e6cea-a805-40d5-8a0e-32de45344e6d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:38:00.183895 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-e48e6cea-a805-40d5-8a0e-32de45344e6d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:00.183895 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell0:SELECT=8 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:38:00.188288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e48e6cea-a805-40d5-8a0e-32de45344e6d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:00.188742 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e48e6cea-a805-40d5-8a0e-32de45344e6d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:00.189508 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e48e6cea-a805-40d5-8a0e-32de45344e6d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:00.189943 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e48e6cea-a805-40d5-8a0e-32de45344e6d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:00.217191 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.objects.instance [None req-e48e6cea-a805-40d5-8a0e-32de45344e6d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lazy-loading 'flavor' on Instance uuid 7744db71-f29c-4221-af51-e3688c4fbc97 {{(pid=124869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:38:00.639074 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-e48e6cea-a805-40d5-8a0e-32de45344e6d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "POST /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97/action" status: 200 len: 32 microversion: 2.1 time: 0.462511 Jun 27 09:38:00.639876 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 115/225] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 27 09:38:00 2022] POST /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97/action => generated 32 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 09:38:00.650122 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-1ba4be4e-a442-4ed3-bb8c-a4ba47586f80 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:00.650908 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-1ba4be4e-a442-4ed3-bb8c-a4ba47586f80 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:00.658253 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1ba4be4e-a442-4ed3-bb8c-a4ba47586f80 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:00.658709 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1ba4be4e-a442-4ed3-bb8c-a4ba47586f80 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:00.659485 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1ba4be4e-a442-4ed3-bb8c-a4ba47586f80 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:00.659993 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1ba4be4e-a442-4ed3-bb8c-a4ba47586f80 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:00.792008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-1ba4be4e-a442-4ed3-bb8c-a4ba47586f80 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:00.799889 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-1ba4be4e-a442-4ed3-bb8c-a4ba47586f80 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.154922 Jun 27 09:38:00.800462 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 111/226] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:00 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:01.033649 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-a8a419bb-06e6-4812-8872-3886e69eede4 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:01.034226 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-a8a419bb-06e6-4812-8872-3886e69eede4 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:01.041205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a8a419bb-06e6-4812-8872-3886e69eede4 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:01.041646 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a8a419bb-06e6-4812-8872-3886e69eede4 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:01.042440 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a8a419bb-06e6-4812-8872-3886e69eede4 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:01.042871 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a8a419bb-06e6-4812-8872-3886e69eede4 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:01.176391 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-a8a419bb-06e6-4812-8872-3886e69eede4 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:01.184478 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-a8a419bb-06e6-4812-8872-3886e69eede4 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1366 microversion: 2.1 time: 0.155180 Jun 27 09:38:01.185105 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 116/227] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:01 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:01.593932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-1fc173a7-76fb-4571-a7e3-1bb67e723f24 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:01.594444 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-1fc173a7-76fb-4571-a7e3-1bb67e723f24 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:01.600896 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1fc173a7-76fb-4571-a7e3-1bb67e723f24 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:01.601966 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1fc173a7-76fb-4571-a7e3-1bb67e723f24 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:01.602746 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1fc173a7-76fb-4571-a7e3-1bb67e723f24 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:01.603203 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1fc173a7-76fb-4571-a7e3-1bb67e723f24 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:01.625262 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-1fc173a7-76fb-4571-a7e3-1bb67e723f24 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a/ips" status: 200 len: 151 microversion: 2.20 time: 0.035190 Jun 27 09:38:01.625738 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 112/228] 10.222.0.64 () {60 vars in 1288 bytes} [Mon Jun 27 09:38:01 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 09:38:01.817221 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-198d2981-c99d-42ba-a02f-6920cb67d820 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:01.817943 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-198d2981-c99d-42ba-a02f-6920cb67d820 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:01.824735 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-198d2981-c99d-42ba-a02f-6920cb67d820 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:01.825404 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-198d2981-c99d-42ba-a02f-6920cb67d820 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:01.826182 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-198d2981-c99d-42ba-a02f-6920cb67d820 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:01.826619 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-198d2981-c99d-42ba-a02f-6920cb67d820 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:01.963560 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-198d2981-c99d-42ba-a02f-6920cb67d820 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:01.970971 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-198d2981-c99d-42ba-a02f-6920cb67d820 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.157652 Jun 27 09:38:01.971587 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 117/229] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:01 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:02.202125 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-bc50a82c-fe77-41fc-ade5-bbae5b406d83 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:02.202738 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-bc50a82c-fe77-41fc-ade5-bbae5b406d83 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:02.208817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-bc50a82c-fe77-41fc-ade5-bbae5b406d83 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:02.209271 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-bc50a82c-fe77-41fc-ade5-bbae5b406d83 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:02.210062 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-bc50a82c-fe77-41fc-ade5-bbae5b406d83 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:02.210502 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-bc50a82c-fe77-41fc-ade5-bbae5b406d83 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:02.345622 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-bc50a82c-fe77-41fc-ade5-bbae5b406d83 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:02.352482 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-bc50a82c-fe77-41fc-ade5-bbae5b406d83 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1366 microversion: 2.1 time: 0.154027 Jun 27 09:38:02.352999 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 113/230] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:02 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:02.987800 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-2c7fcf9a-12e5-47d7-aadd-30582824e481 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:02.988404 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-2c7fcf9a-12e5-47d7-aadd-30582824e481 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:02.994479 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2c7fcf9a-12e5-47d7-aadd-30582824e481 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:02.994932 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2c7fcf9a-12e5-47d7-aadd-30582824e481 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:02.995726 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2c7fcf9a-12e5-47d7-aadd-30582824e481 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:02.996162 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2c7fcf9a-12e5-47d7-aadd-30582824e481 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:03.124437 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2c7fcf9a-12e5-47d7-aadd-30582824e481 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:03.131782 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-2c7fcf9a-12e5-47d7-aadd-30582824e481 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.147801 Jun 27 09:38:03.132337 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 118/231] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:02 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:03.369092 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-fe8ee58d-9916-41b2-8b0d-2e4bede9cae6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:03.369708 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-fe8ee58d-9916-41b2-8b0d-2e4bede9cae6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:03.376763 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fe8ee58d-9916-41b2-8b0d-2e4bede9cae6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:03.377641 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fe8ee58d-9916-41b2-8b0d-2e4bede9cae6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:03.378562 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fe8ee58d-9916-41b2-8b0d-2e4bede9cae6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:03.379009 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fe8ee58d-9916-41b2-8b0d-2e4bede9cae6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:03.512696 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-fe8ee58d-9916-41b2-8b0d-2e4bede9cae6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:03.520318 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-fe8ee58d-9916-41b2-8b0d-2e4bede9cae6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1366 microversion: 2.1 time: 0.155016 Jun 27 09:38:03.520978 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 114/232] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:03 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:04.149294 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-5badd37e-4275-4047-98e9-6909e80c6d0e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:04.149924 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-5badd37e-4275-4047-98e9-6909e80c6d0e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:04.156041 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5badd37e-4275-4047-98e9-6909e80c6d0e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:04.156484 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5badd37e-4275-4047-98e9-6909e80c6d0e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:04.157237 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5badd37e-4275-4047-98e9-6909e80c6d0e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:04.157667 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5badd37e-4275-4047-98e9-6909e80c6d0e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:04.286369 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-5badd37e-4275-4047-98e9-6909e80c6d0e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:04.294557 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-5badd37e-4275-4047-98e9-6909e80c6d0e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.149113 Jun 27 09:38:04.295124 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 119/233] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:04 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:04.537615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-af0b92ac-110d-4746-9e28-4db9a18897f9 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:04.538198 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-af0b92ac-110d-4746-9e28-4db9a18897f9 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:04.545482 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-af0b92ac-110d-4746-9e28-4db9a18897f9 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:04.545930 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-af0b92ac-110d-4746-9e28-4db9a18897f9 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:04.546686 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-af0b92ac-110d-4746-9e28-4db9a18897f9 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:04.547118 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-af0b92ac-110d-4746-9e28-4db9a18897f9 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:04.673556 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-af0b92ac-110d-4746-9e28-4db9a18897f9 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:04.680877 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-af0b92ac-110d-4746-9e28-4db9a18897f9 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1366 microversion: 2.1 time: 0.147133 Jun 27 09:38:04.681431 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 115/234] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:04 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:05.311230 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-2725a528-442e-4003-b60f-032ecd332f7e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:05.311869 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-2725a528-442e-4003-b60f-032ecd332f7e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:05.317904 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2725a528-442e-4003-b60f-032ecd332f7e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:05.318346 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2725a528-442e-4003-b60f-032ecd332f7e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:05.319101 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2725a528-442e-4003-b60f-032ecd332f7e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:05.319563 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2725a528-442e-4003-b60f-032ecd332f7e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:05.444813 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2725a528-442e-4003-b60f-032ecd332f7e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:05.452881 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-2725a528-442e-4003-b60f-032ecd332f7e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.145430 Jun 27 09:38:05.453451 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 120/235] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:05 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:05.696856 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-96e05111-0581-49e6-aee0-5e4cd24d99af tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:05.697470 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-96e05111-0581-49e6-aee0-5e4cd24d99af tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:05.703957 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-96e05111-0581-49e6-aee0-5e4cd24d99af tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:05.704405 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-96e05111-0581-49e6-aee0-5e4cd24d99af tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:05.705166 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-96e05111-0581-49e6-aee0-5e4cd24d99af tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:05.705699 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-96e05111-0581-49e6-aee0-5e4cd24d99af tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:05.830261 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-96e05111-0581-49e6-aee0-5e4cd24d99af tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:05.837574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-96e05111-0581-49e6-aee0-5e4cd24d99af tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1366 microversion: 2.1 time: 0.144646 Jun 27 09:38:05.838144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 116/236] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:05 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:38:06.469390 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-9b408c41-8b38-4793-980d-0b4f04bfa418 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:06.470020 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-9b408c41-8b38-4793-980d-0b4f04bfa418 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:06.476215 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9b408c41-8b38-4793-980d-0b4f04bfa418 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:06.476668 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9b408c41-8b38-4793-980d-0b4f04bfa418 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:06.477440 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9b408c41-8b38-4793-980d-0b4f04bfa418 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:06.477873 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9b408c41-8b38-4793-980d-0b4f04bfa418 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:06.644328 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-9b408c41-8b38-4793-980d-0b4f04bfa418 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:06.651683 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-9b408c41-8b38-4793-980d-0b4f04bfa418 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.186149 Jun 27 09:38:06.652245 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 121/237] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:06 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:06.854358 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-9ceafa2d-d2fd-4446-a8c3-84cc283ddae9 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:06.855019 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-9ceafa2d-d2fd-4446-a8c3-84cc283ddae9 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:06.861696 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9ceafa2d-d2fd-4446-a8c3-84cc283ddae9 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:06.862151 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9ceafa2d-d2fd-4446-a8c3-84cc283ddae9 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:06.862967 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9ceafa2d-d2fd-4446-a8c3-84cc283ddae9 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:06.863556 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9ceafa2d-d2fd-4446-a8c3-84cc283ddae9 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:07.012716 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-9ceafa2d-d2fd-4446-a8c3-84cc283ddae9 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:07.020183 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-9ceafa2d-d2fd-4446-a8c3-84cc283ddae9 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1366 microversion: 2.1 time: 0.169701 Jun 27 09:38:07.022074 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 117/238] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:06 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:38:07.363389 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-52c89931-2a1d-49d6-ad9a-0d81857631b4 req-da081fc2-40ab-42e0-b1e1-fc879771cb4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd479f3-f038-498f-b06d-c47cc1e8bfa2", "name": "network-vif-plugged", "status": "completed", "tag": "95a7b7da-b0e9-4bbd-9924-d201c61db4b4"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:38:07.372087 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-52c89931-2a1d-49d6-ad9a-0d81857631b4 req-da081fc2-40ab-42e0-b1e1-fc879771cb4a service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:07.372529 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-52c89931-2a1d-49d6-ad9a-0d81857631b4 req-da081fc2-40ab-42e0-b1e1-fc879771cb4a service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:07.383476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-52c89931-2a1d-49d6-ad9a-0d81857631b4 req-da081fc2-40ab-42e0-b1e1-fc879771cb4a service nova] Creating event network-vif-plugged:95a7b7da-b0e9-4bbd-9924-d201c61db4b4 for instance 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 on hv-cinder-84773 Jun 27 09:38:07.388528 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-52c89931-2a1d-49d6-ad9a-0d81857631b4 req-da081fc2-40ab-42e0-b1e1-fc879771cb4a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028746 Jun 27 09:38:07.389041 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 122/239] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:38:07.671913 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-d99d9e0a-98db-43b1-b5cf-f3b3c9db6a5a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:07.672520 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-d99d9e0a-98db-43b1-b5cf-f3b3c9db6a5a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:07.674380 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:38:07.679011 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d99d9e0a-98db-43b1-b5cf-f3b3c9db6a5a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:07.679459 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d99d9e0a-98db-43b1-b5cf-f3b3c9db6a5a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:07.680246 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d99d9e0a-98db-43b1-b5cf-f3b3c9db6a5a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:07.680676 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d99d9e0a-98db-43b1-b5cf-f3b3c9db6a5a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:07.805125 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d99d9e0a-98db-43b1-b5cf-f3b3c9db6a5a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:07.812756 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-d99d9e0a-98db-43b1-b5cf-f3b3c9db6a5a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.144853 Jun 27 09:38:07.813322 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 118/240] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:07 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:08.048404 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-54afba24-ac7d-41e3-a4da-2e4a84729f5e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:08.048404 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-54afba24-ac7d-41e3-a4da-2e4a84729f5e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:08.052786 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-54afba24-ac7d-41e3-a4da-2e4a84729f5e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:08.053236 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-54afba24-ac7d-41e3-a4da-2e4a84729f5e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:08.054055 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-54afba24-ac7d-41e3-a4da-2e4a84729f5e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:08.054707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-54afba24-ac7d-41e3-a4da-2e4a84729f5e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:08.188060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-54afba24-ac7d-41e3-a4da-2e4a84729f5e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:08.195996 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-54afba24-ac7d-41e3-a4da-2e4a84729f5e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1366 microversion: 2.1 time: 0.155889 Jun 27 09:38:08.196549 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 123/241] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:08 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:08.830502 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-0ada7f1e-8a64-4319-aa1a-3d5503657942 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:08.831075 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-0ada7f1e-8a64-4319-aa1a-3d5503657942 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:08.837700 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0ada7f1e-8a64-4319-aa1a-3d5503657942 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:08.838151 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0ada7f1e-8a64-4319-aa1a-3d5503657942 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:08.838908 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0ada7f1e-8a64-4319-aa1a-3d5503657942 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:08.839346 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0ada7f1e-8a64-4319-aa1a-3d5503657942 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:08.963800 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-0ada7f1e-8a64-4319-aa1a-3d5503657942 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:08.971230 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-0ada7f1e-8a64-4319-aa1a-3d5503657942 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.144991 Jun 27 09:38:08.971825 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 119/242] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:08 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:09.212889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-89fd8a8a-ead8-456f-9bd3-3559e24f20f7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:09.213491 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-89fd8a8a-ead8-456f-9bd3-3559e24f20f7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:09.219547 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-89fd8a8a-ead8-456f-9bd3-3559e24f20f7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:09.220002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-89fd8a8a-ead8-456f-9bd3-3559e24f20f7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:09.220755 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-89fd8a8a-ead8-456f-9bd3-3559e24f20f7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:09.221193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-89fd8a8a-ead8-456f-9bd3-3559e24f20f7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:09.347832 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-89fd8a8a-ead8-456f-9bd3-3559e24f20f7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:09.355268 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-89fd8a8a-ead8-456f-9bd3-3559e24f20f7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1366 microversion: 2.1 time: 0.146725 Jun 27 09:38:09.355866 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 124/243] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:09 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:09.988706 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-9d85cc23-9aac-43ab-995e-cebfede0039f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:09.989327 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-9d85cc23-9aac-43ab-995e-cebfede0039f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:09.997127 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9d85cc23-9aac-43ab-995e-cebfede0039f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:09.997812 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9d85cc23-9aac-43ab-995e-cebfede0039f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:09.998952 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9d85cc23-9aac-43ab-995e-cebfede0039f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:09.999620 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9d85cc23-9aac-43ab-995e-cebfede0039f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:10.172017 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-9d85cc23-9aac-43ab-995e-cebfede0039f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:10.181050 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-9d85cc23-9aac-43ab-995e-cebfede0039f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.196732 Jun 27 09:38:10.181717 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 120/244] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:09 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:10.372603 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-251eed44-0c84-4c5e-8647-a7a4e2723fb9 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:10.373205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-251eed44-0c84-4c5e-8647-a7a4e2723fb9 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:10.379160 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-251eed44-0c84-4c5e-8647-a7a4e2723fb9 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:10.379645 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-251eed44-0c84-4c5e-8647-a7a4e2723fb9 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:10.380392 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-251eed44-0c84-4c5e-8647-a7a4e2723fb9 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:10.380819 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-251eed44-0c84-4c5e-8647-a7a4e2723fb9 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:10.513396 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-251eed44-0c84-4c5e-8647-a7a4e2723fb9 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:10.520904 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-251eed44-0c84-4c5e-8647-a7a4e2723fb9 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1366 microversion: 2.1 time: 0.152190 Jun 27 09:38:10.521481 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 125/245] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:10 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:11.198870 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-3a5545d9-e735-4aa2-a40b-7e68f0a1937f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:11.199479 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-3a5545d9-e735-4aa2-a40b-7e68f0a1937f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:11.206075 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3a5545d9-e735-4aa2-a40b-7e68f0a1937f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:11.206525 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3a5545d9-e735-4aa2-a40b-7e68f0a1937f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:11.207292 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3a5545d9-e735-4aa2-a40b-7e68f0a1937f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:11.207757 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3a5545d9-e735-4aa2-a40b-7e68f0a1937f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:11.281205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-cc3908de-6682-4b80-bd2e-854dbf27357f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:38:11.281855 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-cc3908de-6682-4b80-bd2e-854dbf27357f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:11.288869 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-cc3908de-6682-4b80-bd2e-854dbf27357f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:11.289555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-cc3908de-6682-4b80-bd2e-854dbf27357f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:11.290771 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-cc3908de-6682-4b80-bd2e-854dbf27357f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:11.291414 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-cc3908de-6682-4b80-bd2e-854dbf27357f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:11.316264 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.objects.instance [None req-cc3908de-6682-4b80-bd2e-854dbf27357f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lazy-loading 'flavor' on Instance uuid 1d72055f-6915-43b5-9831-61c2f134e60a {{(pid=124869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:38:11.353579 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-3a5545d9-e735-4aa2-a40b-7e68f0a1937f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:11.363782 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-3a5545d9-e735-4aa2-a40b-7e68f0a1937f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.169547 Jun 27 09:38:11.364359 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 121/246] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:11 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:11.540975 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a9ca6635-7634-4b05-9a12-10a1ee90fe55 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:11.541580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-a9ca6635-7634-4b05-9a12-10a1ee90fe55 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:11.547481 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a9ca6635-7634-4b05-9a12-10a1ee90fe55 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:11.547950 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a9ca6635-7634-4b05-9a12-10a1ee90fe55 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:11.548702 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a9ca6635-7634-4b05-9a12-10a1ee90fe55 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:11.549130 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a9ca6635-7634-4b05-9a12-10a1ee90fe55 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:11.858077 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-cc3908de-6682-4b80-bd2e-854dbf27357f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "POST /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a/action" status: 202 len: 0 microversion: 2.20 time: 0.581187 Jun 27 09:38:11.858907 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 126/247] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jun 27 09:38:11 2022] POST /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 27 09:38:11.867825 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-5591776a-b553-44bc-b987-cc49ceb93133 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:11.868594 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-5591776a-b553-44bc-b987-cc49ceb93133 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:11.874750 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5591776a-b553-44bc-b987-cc49ceb93133 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:11.875228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5591776a-b553-44bc-b987-cc49ceb93133 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:11.875972 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a9ca6635-7634-4b05-9a12-10a1ee90fe55 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:11.876101 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5591776a-b553-44bc-b987-cc49ceb93133 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:11.876460 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5591776a-b553-44bc-b987-cc49ceb93133 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:11.880551 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:38:11.883571 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-a9ca6635-7634-4b05-9a12-10a1ee90fe55 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1366 microversion: 2.1 time: 0.348970 Jun 27 09:38:11.884146 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 122/248] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:11 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:38:12.002395 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-5591776a-b553-44bc-b987-cc49ceb93133 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:12.010044 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-5591776a-b553-44bc-b987-cc49ceb93133 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:12.011552 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-5591776a-b553-44bc-b987-cc49ceb93133 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:12.012681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-5591776a-b553-44bc-b987-cc49ceb93133 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1723 microversion: 2.20 time: 0.149614 Jun 27 09:38:12.013354 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 127/249] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:11 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:38:12.381171 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-4de9d63e-9c51-4943-ae36-dc9a1323a74b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:12.381737 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-4de9d63e-9c51-4943-ae36-dc9a1323a74b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:12.388681 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4de9d63e-9c51-4943-ae36-dc9a1323a74b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:12.389125 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4de9d63e-9c51-4943-ae36-dc9a1323a74b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:12.389875 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4de9d63e-9c51-4943-ae36-dc9a1323a74b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:12.390306 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4de9d63e-9c51-4943-ae36-dc9a1323a74b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:12.514323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4de9d63e-9c51-4943-ae36-dc9a1323a74b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:12.523469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-4de9d63e-9c51-4943-ae36-dc9a1323a74b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.145465 Jun 27 09:38:12.524075 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 123/250] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:12 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:12.900658 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-6a1bbf71-a4dd-4eb8-bf95-a097dc91560f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:12.901192 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-6a1bbf71-a4dd-4eb8-bf95-a097dc91560f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:12.907356 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6a1bbf71-a4dd-4eb8-bf95-a097dc91560f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:12.907846 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6a1bbf71-a4dd-4eb8-bf95-a097dc91560f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:12.908612 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6a1bbf71-a4dd-4eb8-bf95-a097dc91560f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:12.909048 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6a1bbf71-a4dd-4eb8-bf95-a097dc91560f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:13.031575 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-244c03b4-44f1-42d9-ae38-f084bae1eae7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:13.032284 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-244c03b4-44f1-42d9-ae38-f084bae1eae7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:13.038973 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-244c03b4-44f1-42d9-ae38-f084bae1eae7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:13.039105 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6a1bbf71-a4dd-4eb8-bf95-a097dc91560f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:13.039421 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-244c03b4-44f1-42d9-ae38-f084bae1eae7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:13.040463 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-244c03b4-44f1-42d9-ae38-f084bae1eae7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:13.040897 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-244c03b4-44f1-42d9-ae38-f084bae1eae7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:13.047069 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-6a1bbf71-a4dd-4eb8-bf95-a097dc91560f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1366 microversion: 2.1 time: 0.150289 Jun 27 09:38:13.047672 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 128/251] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:12 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:38:13.169535 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-244c03b4-44f1-42d9-ae38-f084bae1eae7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:13.177438 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-244c03b4-44f1-42d9-ae38-f084bae1eae7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:13.178951 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-244c03b4-44f1-42d9-ae38-f084bae1eae7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:13.180719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-244c03b4-44f1-42d9-ae38-f084bae1eae7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1723 microversion: 2.20 time: 0.153098 Jun 27 09:38:13.181281 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 124/252] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:13 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:38:13.540724 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-af3f64e8-e818-441e-8c25-59369df505c3 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:13.541336 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-af3f64e8-e818-441e-8c25-59369df505c3 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:13.548136 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-af3f64e8-e818-441e-8c25-59369df505c3 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:13.548595 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-af3f64e8-e818-441e-8c25-59369df505c3 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:13.549374 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-af3f64e8-e818-441e-8c25-59369df505c3 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:13.549817 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-af3f64e8-e818-441e-8c25-59369df505c3 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:13.677767 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-af3f64e8-e818-441e-8c25-59369df505c3 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:13.685063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-af3f64e8-e818-441e-8c25-59369df505c3 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.148925 Jun 27 09:38:13.685621 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 129/253] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:13 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:14.075422 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a40fb3bc-cb99-4c1e-92bb-fa52d727fd8f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:14.075422 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-a40fb3bc-cb99-4c1e-92bb-fa52d727fd8f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:14.077611 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a40fb3bc-cb99-4c1e-92bb-fa52d727fd8f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:14.078065 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a40fb3bc-cb99-4c1e-92bb-fa52d727fd8f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:14.078826 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a40fb3bc-cb99-4c1e-92bb-fa52d727fd8f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:14.079264 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a40fb3bc-cb99-4c1e-92bb-fa52d727fd8f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:14.203276 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e78a51f1-27a0-4a8e-9f34-1c08b94ee30e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:14.207378 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-e78a51f1-27a0-4a8e-9f34-1c08b94ee30e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:14.210584 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e78a51f1-27a0-4a8e-9f34-1c08b94ee30e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:14.211114 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e78a51f1-27a0-4a8e-9f34-1c08b94ee30e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:14.211993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e78a51f1-27a0-4a8e-9f34-1c08b94ee30e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:14.212547 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e78a51f1-27a0-4a8e-9f34-1c08b94ee30e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:14.213116 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a40fb3bc-cb99-4c1e-92bb-fa52d727fd8f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:14.221585 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-a40fb3bc-cb99-4c1e-92bb-fa52d727fd8f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1366 microversion: 2.1 time: 0.155349 Jun 27 09:38:14.222160 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 125/254] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:14 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:38:14.348953 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e78a51f1-27a0-4a8e-9f34-1c08b94ee30e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:14.356830 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e78a51f1-27a0-4a8e-9f34-1c08b94ee30e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:14.358328 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e78a51f1-27a0-4a8e-9f34-1c08b94ee30e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:14.359470 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-e78a51f1-27a0-4a8e-9f34-1c08b94ee30e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1723 microversion: 2.20 time: 0.164764 Jun 27 09:38:14.360048 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 130/255] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:14 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:38:14.701919 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-90072379-b771-4929-8995-f5c9f94df234 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:14.702535 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-90072379-b771-4929-8995-f5c9f94df234 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:14.710087 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-90072379-b771-4929-8995-f5c9f94df234 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:14.714719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-90072379-b771-4929-8995-f5c9f94df234 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:14.714719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-90072379-b771-4929-8995-f5c9f94df234 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:14.714719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-90072379-b771-4929-8995-f5c9f94df234 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:14.847949 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-90072379-b771-4929-8995-f5c9f94df234 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:14.855911 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-90072379-b771-4929-8995-f5c9f94df234 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.157817 Jun 27 09:38:14.856408 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 126/256] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:14 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:15.240086 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-07fd27ee-f8da-4b36-8a46-5378aa2d8f99 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:15.241206 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-07fd27ee-f8da-4b36-8a46-5378aa2d8f99 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:15.248020 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-07fd27ee-f8da-4b36-8a46-5378aa2d8f99 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:15.248473 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-07fd27ee-f8da-4b36-8a46-5378aa2d8f99 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:15.249246 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-07fd27ee-f8da-4b36-8a46-5378aa2d8f99 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:15.249707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-07fd27ee-f8da-4b36-8a46-5378aa2d8f99 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:15.383918 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-608ebd64-ce07-444f-a8a9-1baacd047922 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:15.385153 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-608ebd64-ce07-444f-a8a9-1baacd047922 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:15.394751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-608ebd64-ce07-444f-a8a9-1baacd047922 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:15.395484 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-608ebd64-ce07-444f-a8a9-1baacd047922 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:15.397165 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-608ebd64-ce07-444f-a8a9-1baacd047922 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:15.397676 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-608ebd64-ce07-444f-a8a9-1baacd047922 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:15.417739 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-07fd27ee-f8da-4b36-8a46-5378aa2d8f99 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:15.434999 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=100 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:38:15.435275 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-07fd27ee-f8da-4b36-8a46-5378aa2d8f99 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1556 microversion: 2.1 time: 0.200755 Jun 27 09:38:15.435896 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 131/257] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:15 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1556 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:15.453407 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-68ff3e99-d66d-4d40-b64a-3a8f665d6740 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:15.454099 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-68ff3e99-d66d-4d40-b64a-3a8f665d6740 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:15.460840 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-68ff3e99-d66d-4d40-b64a-3a8f665d6740 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:15.461990 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-68ff3e99-d66d-4d40-b64a-3a8f665d6740 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:15.462869 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-68ff3e99-d66d-4d40-b64a-3a8f665d6740 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:15.463454 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-68ff3e99-d66d-4d40-b64a-3a8f665d6740 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:15.557754 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-68ff3e99-d66d-4d40-b64a-3a8f665d6740 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108835 Jun 27 09:38:15.558473 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 132/258] 10.222.0.64 () {58 vars in 1274 bytes} [Mon Jun 27 09:38:15 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:38:15.637597 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-608ebd64-ce07-444f-a8a9-1baacd047922 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:15.647194 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-608ebd64-ce07-444f-a8a9-1baacd047922 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:15.649096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-608ebd64-ce07-444f-a8a9-1baacd047922 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:15.650836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-608ebd64-ce07-444f-a8a9-1baacd047922 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1723 microversion: 2.20 time: 0.275182 Jun 27 09:38:15.652537 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 127/259] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:15 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:15.873985 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-b79f627e-8986-44fe-9682-02f8030423a9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:15.874855 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-b79f627e-8986-44fe-9682-02f8030423a9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:15.881975 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b79f627e-8986-44fe-9682-02f8030423a9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:15.882646 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b79f627e-8986-44fe-9682-02f8030423a9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:15.884372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b79f627e-8986-44fe-9682-02f8030423a9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:15.884878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b79f627e-8986-44fe-9682-02f8030423a9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:16.309174 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-b79f627e-8986-44fe-9682-02f8030423a9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:16.319833 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-b79f627e-8986-44fe-9682-02f8030423a9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.450463 Jun 27 09:38:16.320572 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 133/260] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:15 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:16.670859 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-0ac10596-1195-47cd-bfb5-c8981414c046 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:16.671651 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-0ac10596-1195-47cd-bfb5-c8981414c046 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:16.678128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0ac10596-1195-47cd-bfb5-c8981414c046 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:16.678828 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0ac10596-1195-47cd-bfb5-c8981414c046 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:16.679642 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0ac10596-1195-47cd-bfb5-c8981414c046 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:16.680157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0ac10596-1195-47cd-bfb5-c8981414c046 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:16.875606 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-0ac10596-1195-47cd-bfb5-c8981414c046 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:16.884898 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-0ac10596-1195-47cd-bfb5-c8981414c046 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:16.886959 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-0ac10596-1195-47cd-bfb5-c8981414c046 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:16.888484 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-0ac10596-1195-47cd-bfb5-c8981414c046 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1723 microversion: 2.20 time: 0.221721 Jun 27 09:38:16.889128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 128/261] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:16 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:17.049862 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-f0d77d29-2857-400e-ae21-038f22923ebe req-6f0857da-11d1-4269-9ec7-9858dd1b8b8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dd479f3-f038-498f-b06d-c47cc1e8bfa2", "tag": "95a7b7da-b0e9-4bbd-9924-d201c61db4b4"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:38:17.053388 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=66 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:38:17.058918 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-f0d77d29-2857-400e-ae21-038f22923ebe req-6f0857da-11d1-4269-9ec7-9858dd1b8b8c service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:17.059832 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-f0d77d29-2857-400e-ae21-038f22923ebe req-6f0857da-11d1-4269-9ec7-9858dd1b8b8c service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:17.072081 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-f0d77d29-2857-400e-ae21-038f22923ebe req-6f0857da-11d1-4269-9ec7-9858dd1b8b8c service nova] Creating event network-changed:95a7b7da-b0e9-4bbd-9924-d201c61db4b4 for instance 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 on hv-cinder-84773 Jun 27 09:38:17.076974 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-f0d77d29-2857-400e-ae21-038f22923ebe req-6f0857da-11d1-4269-9ec7-9858dd1b8b8c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030858 Jun 27 09:38:17.077780 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 134/262] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:38:17.336383 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-209ec806-a29a-4528-9a7c-5d5a264d36b5 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:17.336994 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-209ec806-a29a-4528-9a7c-5d5a264d36b5 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:17.343369 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-209ec806-a29a-4528-9a7c-5d5a264d36b5 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:17.343862 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-209ec806-a29a-4528-9a7c-5d5a264d36b5 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:17.344678 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-209ec806-a29a-4528-9a7c-5d5a264d36b5 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:17.345122 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-209ec806-a29a-4528-9a7c-5d5a264d36b5 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:17.485562 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-209ec806-a29a-4528-9a7c-5d5a264d36b5 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:17.499036 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-209ec806-a29a-4528-9a7c-5d5a264d36b5 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.166456 Jun 27 09:38:17.508516 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 129/263] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:17 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:17.908488 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-c0d65dad-04d8-4825-b7bf-dcc0dd4539df tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:17.909171 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-c0d65dad-04d8-4825-b7bf-dcc0dd4539df tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:17.917557 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c0d65dad-04d8-4825-b7bf-dcc0dd4539df tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:17.918184 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c0d65dad-04d8-4825-b7bf-dcc0dd4539df tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:17.918939 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c0d65dad-04d8-4825-b7bf-dcc0dd4539df tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:17.919367 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c0d65dad-04d8-4825-b7bf-dcc0dd4539df tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:18.059807 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-c0d65dad-04d8-4825-b7bf-dcc0dd4539df tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:18.067885 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-c0d65dad-04d8-4825-b7bf-dcc0dd4539df tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:18.069594 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-c0d65dad-04d8-4825-b7bf-dcc0dd4539df tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:18.071074 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-c0d65dad-04d8-4825-b7bf-dcc0dd4539df tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1723 microversion: 2.20 time: 0.167224 Jun 27 09:38:18.080961 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 135/264] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:17 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:38:18.516149 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a1322f19-36a4-40de-a0fb-9be63ac30e96 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:18.516773 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-a1322f19-36a4-40de-a0fb-9be63ac30e96 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:18.523648 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a1322f19-36a4-40de-a0fb-9be63ac30e96 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:18.524088 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a1322f19-36a4-40de-a0fb-9be63ac30e96 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:18.528344 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a1322f19-36a4-40de-a0fb-9be63ac30e96 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:18.528344 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a1322f19-36a4-40de-a0fb-9be63ac30e96 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:18.685968 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a1322f19-36a4-40de-a0fb-9be63ac30e96 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:18.693538 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-a1322f19-36a4-40de-a0fb-9be63ac30e96 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.181309 Jun 27 09:38:18.699648 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 130/265] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:18 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:19.090236 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-9a0d983c-a1d9-4ba3-9115-14df253fcde1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:19.090856 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-9a0d983c-a1d9-4ba3-9115-14df253fcde1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:19.096919 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9a0d983c-a1d9-4ba3-9115-14df253fcde1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:19.098977 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9a0d983c-a1d9-4ba3-9115-14df253fcde1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:19.098977 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9a0d983c-a1d9-4ba3-9115-14df253fcde1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:19.098977 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9a0d983c-a1d9-4ba3-9115-14df253fcde1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:19.231154 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-9a0d983c-a1d9-4ba3-9115-14df253fcde1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:19.239321 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-9a0d983c-a1d9-4ba3-9115-14df253fcde1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:19.240979 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-9a0d983c-a1d9-4ba3-9115-14df253fcde1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:19.242414 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-9a0d983c-a1d9-4ba3-9115-14df253fcde1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1723 microversion: 2.20 time: 0.156068 Jun 27 09:38:19.243001 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 136/266] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:19 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:19.710165 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-3f7e55f5-8b3a-4856-8eb9-8a8678d04595 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:19.710823 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-3f7e55f5-8b3a-4856-8eb9-8a8678d04595 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:19.718031 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3f7e55f5-8b3a-4856-8eb9-8a8678d04595 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:19.718485 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3f7e55f5-8b3a-4856-8eb9-8a8678d04595 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:19.719259 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3f7e55f5-8b3a-4856-8eb9-8a8678d04595 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:19.719728 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3f7e55f5-8b3a-4856-8eb9-8a8678d04595 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:19.862283 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-3f7e55f5-8b3a-4856-8eb9-8a8678d04595 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:19.869993 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-3f7e55f5-8b3a-4856-8eb9-8a8678d04595 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.163639 Jun 27 09:38:19.870736 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 131/267] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:19 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:20.266007 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-0a018f9f-165d-43b2-9dc1-208d80df9ed6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:20.266876 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-0a018f9f-165d-43b2-9dc1-208d80df9ed6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:20.280639 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0a018f9f-165d-43b2-9dc1-208d80df9ed6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:20.281087 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0a018f9f-165d-43b2-9dc1-208d80df9ed6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:20.281917 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0a018f9f-165d-43b2-9dc1-208d80df9ed6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:20.282331 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0a018f9f-165d-43b2-9dc1-208d80df9ed6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:20.415394 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-0a018f9f-165d-43b2-9dc1-208d80df9ed6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:20.423595 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-0a018f9f-165d-43b2-9dc1-208d80df9ed6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:20.425241 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-0a018f9f-165d-43b2-9dc1-208d80df9ed6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:20.426473 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-0a018f9f-165d-43b2-9dc1-208d80df9ed6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1723 microversion: 2.20 time: 0.168395 Jun 27 09:38:20.427306 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 137/268] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:20 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:20.885877 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-f00c0c02-a94e-4b25-8f6d-36a2f6902a13 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:20.886523 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-f00c0c02-a94e-4b25-8f6d-36a2f6902a13 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:20.893056 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f00c0c02-a94e-4b25-8f6d-36a2f6902a13 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:20.893506 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f00c0c02-a94e-4b25-8f6d-36a2f6902a13 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:20.894511 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f00c0c02-a94e-4b25-8f6d-36a2f6902a13 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:20.894979 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f00c0c02-a94e-4b25-8f6d-36a2f6902a13 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:21.027144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-f00c0c02-a94e-4b25-8f6d-36a2f6902a13 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:21.037915 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-f00c0c02-a94e-4b25-8f6d-36a2f6902a13 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.152746 Jun 27 09:38:21.037915 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 132/269] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:20 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:21.445529 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-d0e58e89-2f26-438c-9732-e03d8250a300 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:21.446131 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-d0e58e89-2f26-438c-9732-e03d8250a300 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:21.452618 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d0e58e89-2f26-438c-9732-e03d8250a300 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:21.453063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d0e58e89-2f26-438c-9732-e03d8250a300 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:21.453814 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d0e58e89-2f26-438c-9732-e03d8250a300 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:21.454248 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d0e58e89-2f26-438c-9732-e03d8250a300 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:21.579850 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-d0e58e89-2f26-438c-9732-e03d8250a300 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:21.587758 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-d0e58e89-2f26-438c-9732-e03d8250a300 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:21.589301 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-d0e58e89-2f26-438c-9732-e03d8250a300 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:21.590467 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-d0e58e89-2f26-438c-9732-e03d8250a300 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1723 microversion: 2.20 time: 0.148897 Jun 27 09:38:21.590983 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 138/270] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:21 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:22.053763 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-4b842a04-7ec8-4852-9fb3-0288fc742d41 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:22.054370 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-4b842a04-7ec8-4852-9fb3-0288fc742d41 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:22.061925 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4b842a04-7ec8-4852-9fb3-0288fc742d41 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:22.062379 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4b842a04-7ec8-4852-9fb3-0288fc742d41 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:22.063176 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4b842a04-7ec8-4852-9fb3-0288fc742d41 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:22.063635 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4b842a04-7ec8-4852-9fb3-0288fc742d41 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:22.192745 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4b842a04-7ec8-4852-9fb3-0288fc742d41 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:22.200266 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-4b842a04-7ec8-4852-9fb3-0288fc742d41 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.150534 Jun 27 09:38:22.200945 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 133/271] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:22 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:22.609081 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-2c37b9bf-80d5-4b87-87ae-b6173c095764 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:22.609683 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-2c37b9bf-80d5-4b87-87ae-b6173c095764 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:22.615693 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2c37b9bf-80d5-4b87-87ae-b6173c095764 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:22.616140 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2c37b9bf-80d5-4b87-87ae-b6173c095764 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:22.616902 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2c37b9bf-80d5-4b87-87ae-b6173c095764 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:22.617337 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2c37b9bf-80d5-4b87-87ae-b6173c095764 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:22.746275 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2c37b9bf-80d5-4b87-87ae-b6173c095764 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:22.754224 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2c37b9bf-80d5-4b87-87ae-b6173c095764 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:22.755746 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2c37b9bf-80d5-4b87-87ae-b6173c095764 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:22.756896 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-2c37b9bf-80d5-4b87-87ae-b6173c095764 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1723 microversion: 2.20 time: 0.151693 Jun 27 09:38:22.757634 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 139/272] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:22 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:23.217597 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-8e1514f8-80a8-4fe0-be2f-033e81441829 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:23.218287 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-8e1514f8-80a8-4fe0-be2f-033e81441829 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:23.224919 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8e1514f8-80a8-4fe0-be2f-033e81441829 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:23.227238 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8e1514f8-80a8-4fe0-be2f-033e81441829 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:23.227238 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8e1514f8-80a8-4fe0-be2f-033e81441829 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:23.227238 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8e1514f8-80a8-4fe0-be2f-033e81441829 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:23.361874 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8e1514f8-80a8-4fe0-be2f-033e81441829 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:23.369799 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-8e1514f8-80a8-4fe0-be2f-033e81441829 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.156119 Jun 27 09:38:23.370423 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 134/273] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:23 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:23.775756 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e9249bf6-b4cc-4fe7-9106-b81b9dd046c6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:23.776486 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-e9249bf6-b4cc-4fe7-9106-b81b9dd046c6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:23.783301 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e9249bf6-b4cc-4fe7-9106-b81b9dd046c6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:23.784038 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e9249bf6-b4cc-4fe7-9106-b81b9dd046c6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:23.784904 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e9249bf6-b4cc-4fe7-9106-b81b9dd046c6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:23.785274 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e9249bf6-b4cc-4fe7-9106-b81b9dd046c6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:23.921028 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e9249bf6-b4cc-4fe7-9106-b81b9dd046c6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:23.927716 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e9249bf6-b4cc-4fe7-9106-b81b9dd046c6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:23.929289 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e9249bf6-b4cc-4fe7-9106-b81b9dd046c6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:23.930438 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-e9249bf6-b4cc-4fe7-9106-b81b9dd046c6 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1723 microversion: 2.20 time: 0.158657 Jun 27 09:38:23.930992 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 140/274] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:23 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:24.388862 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c4dbd9ec-62c6-4f6d-9cab-a196486b6bcd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:24.389585 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-c4dbd9ec-62c6-4f6d-9cab-a196486b6bcd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:24.396141 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c4dbd9ec-62c6-4f6d-9cab-a196486b6bcd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:24.396658 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c4dbd9ec-62c6-4f6d-9cab-a196486b6bcd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:24.397428 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c4dbd9ec-62c6-4f6d-9cab-a196486b6bcd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:24.397857 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c4dbd9ec-62c6-4f6d-9cab-a196486b6bcd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:24.539739 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-c4dbd9ec-62c6-4f6d-9cab-a196486b6bcd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:24.547582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-c4dbd9ec-62c6-4f6d-9cab-a196486b6bcd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.165359 Jun 27 09:38:24.548256 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 135/275] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:24 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:24.948581 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-a5a9404d-1179-48f7-8c94-0119d0659854 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:24.949216 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-a5a9404d-1179-48f7-8c94-0119d0659854 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:24.955400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a5a9404d-1179-48f7-8c94-0119d0659854 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:24.955893 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a5a9404d-1179-48f7-8c94-0119d0659854 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:24.956722 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a5a9404d-1179-48f7-8c94-0119d0659854 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:24.957163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a5a9404d-1179-48f7-8c94-0119d0659854 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:25.081706 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-a5a9404d-1179-48f7-8c94-0119d0659854 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:25.089655 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-a5a9404d-1179-48f7-8c94-0119d0659854 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:25.091172 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-a5a9404d-1179-48f7-8c94-0119d0659854 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:25.092352 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-a5a9404d-1179-48f7-8c94-0119d0659854 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1723 microversion: 2.20 time: 0.148486 Jun 27 09:38:25.092969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 141/276] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:24 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:25.565250 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-d0807596-937c-491d-91dd-cc1cf1b1d1fe tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:25.565865 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-d0807596-937c-491d-91dd-cc1cf1b1d1fe tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:25.572479 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d0807596-937c-491d-91dd-cc1cf1b1d1fe tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:25.572930 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d0807596-937c-491d-91dd-cc1cf1b1d1fe tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:25.573697 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d0807596-937c-491d-91dd-cc1cf1b1d1fe tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:25.574138 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d0807596-937c-491d-91dd-cc1cf1b1d1fe tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:25.703557 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d0807596-937c-491d-91dd-cc1cf1b1d1fe tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:25.710918 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-d0807596-937c-491d-91dd-cc1cf1b1d1fe tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.149510 Jun 27 09:38:25.711509 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 136/277] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:25 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:26.110465 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-d0cd46fb-9a10-4b3b-b8e2-ad8f45a95cec tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:26.111074 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-d0cd46fb-9a10-4b3b-b8e2-ad8f45a95cec tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:26.117110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d0cd46fb-9a10-4b3b-b8e2-ad8f45a95cec tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:26.117563 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d0cd46fb-9a10-4b3b-b8e2-ad8f45a95cec tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:26.118316 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d0cd46fb-9a10-4b3b-b8e2-ad8f45a95cec tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:26.119297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d0cd46fb-9a10-4b3b-b8e2-ad8f45a95cec tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:26.248321 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-d0cd46fb-9a10-4b3b-b8e2-ad8f45a95cec tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:26.256303 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-d0cd46fb-9a10-4b3b-b8e2-ad8f45a95cec tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:26.257803 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-d0cd46fb-9a10-4b3b-b8e2-ad8f45a95cec tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:26.258951 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-d0cd46fb-9a10-4b3b-b8e2-ad8f45a95cec tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1723 microversion: 2.20 time: 0.152412 Jun 27 09:38:26.260056 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 142/278] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:26 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:26.727708 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-1d1fd595-ee51-4420-b9c7-ff093dd85731 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:26.728800 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-1d1fd595-ee51-4420-b9c7-ff093dd85731 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:26.735220 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1d1fd595-ee51-4420-b9c7-ff093dd85731 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:26.735708 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1d1fd595-ee51-4420-b9c7-ff093dd85731 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:26.736458 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1d1fd595-ee51-4420-b9c7-ff093dd85731 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:26.736887 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1d1fd595-ee51-4420-b9c7-ff093dd85731 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:26.864313 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-1d1fd595-ee51-4420-b9c7-ff093dd85731 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:26.872643 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-1d1fd595-ee51-4420-b9c7-ff093dd85731 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.148699 Jun 27 09:38:26.873444 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 137/279] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:26 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:27.277959 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-23c51503-04e5-4152-89c7-b07925cf3522 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:27.278569 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-23c51503-04e5-4152-89c7-b07925cf3522 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:27.284795 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-23c51503-04e5-4152-89c7-b07925cf3522 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:27.285244 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-23c51503-04e5-4152-89c7-b07925cf3522 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:27.286012 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-23c51503-04e5-4152-89c7-b07925cf3522 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:27.286446 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-23c51503-04e5-4152-89c7-b07925cf3522 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:27.414728 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-23c51503-04e5-4152-89c7-b07925cf3522 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:27.423321 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-23c51503-04e5-4152-89c7-b07925cf3522 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:27.424864 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-23c51503-04e5-4152-89c7-b07925cf3522 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:27.426012 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-23c51503-04e5-4152-89c7-b07925cf3522 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1723 microversion: 2.20 time: 0.152301 Jun 27 09:38:27.426566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 143/280] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:27 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:27.889871 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a6d3ee9a-4584-457d-848b-14176ab1d505 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:27.890513 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-a6d3ee9a-4584-457d-848b-14176ab1d505 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:27.896856 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a6d3ee9a-4584-457d-848b-14176ab1d505 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:27.897362 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a6d3ee9a-4584-457d-848b-14176ab1d505 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:27.898046 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a6d3ee9a-4584-457d-848b-14176ab1d505 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:27.898554 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a6d3ee9a-4584-457d-848b-14176ab1d505 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:28.047171 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a6d3ee9a-4584-457d-848b-14176ab1d505 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:28.054599 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-a6d3ee9a-4584-457d-848b-14176ab1d505 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.168487 Jun 27 09:38:28.055157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 138/281] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:27 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:28.444649 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-03a50ee0-a78d-474e-8c84-87165cf95111 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:28.445258 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-03a50ee0-a78d-474e-8c84-87165cf95111 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:28.452092 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-03a50ee0-a78d-474e-8c84-87165cf95111 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:28.452541 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-03a50ee0-a78d-474e-8c84-87165cf95111 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:28.453402 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-03a50ee0-a78d-474e-8c84-87165cf95111 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:28.453809 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-03a50ee0-a78d-474e-8c84-87165cf95111 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:28.584195 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-03a50ee0-a78d-474e-8c84-87165cf95111 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:28.586684 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=100 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:38:28.593400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-03a50ee0-a78d-474e-8c84-87165cf95111 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:28.595002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-03a50ee0-a78d-474e-8c84-87165cf95111 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:28.596249 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-03a50ee0-a78d-474e-8c84-87165cf95111 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1723 microversion: 2.20 time: 0.155544 Jun 27 09:38:28.596793 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 144/282] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:28 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:29.071237 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-ecf22256-99fc-4fec-8257-1871c3d45260 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:29.071890 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-ecf22256-99fc-4fec-8257-1871c3d45260 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:29.078386 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ecf22256-99fc-4fec-8257-1871c3d45260 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:29.078831 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ecf22256-99fc-4fec-8257-1871c3d45260 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:29.079612 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ecf22256-99fc-4fec-8257-1871c3d45260 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:29.080050 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ecf22256-99fc-4fec-8257-1871c3d45260 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:29.209979 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-ecf22256-99fc-4fec-8257-1871c3d45260 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:29.217933 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-ecf22256-99fc-4fec-8257-1871c3d45260 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.150489 Jun 27 09:38:29.218645 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 139/283] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:29 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:29.614183 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-dd22e38e-c1d4-4f29-a684-2e910981d67e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:29.614833 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-dd22e38e-c1d4-4f29-a684-2e910981d67e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:29.621092 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dd22e38e-c1d4-4f29-a684-2e910981d67e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:29.621565 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dd22e38e-c1d4-4f29-a684-2e910981d67e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:29.622326 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dd22e38e-c1d4-4f29-a684-2e910981d67e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:29.622762 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dd22e38e-c1d4-4f29-a684-2e910981d67e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:29.752084 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-dd22e38e-c1d4-4f29-a684-2e910981d67e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:29.760497 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-dd22e38e-c1d4-4f29-a684-2e910981d67e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:29.761988 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-dd22e38e-c1d4-4f29-a684-2e910981d67e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:29.763125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-dd22e38e-c1d4-4f29-a684-2e910981d67e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1723 microversion: 2.20 time: 0.153225 Jun 27 09:38:29.763698 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 145/284] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:29 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:30.234771 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-f793ea37-7b61-4e43-822a-9ade4862f97d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:30.235488 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-f793ea37-7b61-4e43-822a-9ade4862f97d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:30.241717 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f793ea37-7b61-4e43-822a-9ade4862f97d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:30.242168 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f793ea37-7b61-4e43-822a-9ade4862f97d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:30.242933 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f793ea37-7b61-4e43-822a-9ade4862f97d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:30.243372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f793ea37-7b61-4e43-822a-9ade4862f97d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:30.368538 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-f793ea37-7b61-4e43-822a-9ade4862f97d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:30.376449 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-f793ea37-7b61-4e43-822a-9ade4862f97d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.145500 Jun 27 09:38:30.377017 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 140/285] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:30 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:30.781205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-a3d3b780-fb13-462f-ac85-14826e9be96c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:30.781802 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-a3d3b780-fb13-462f-ac85-14826e9be96c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:30.787767 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a3d3b780-fb13-462f-ac85-14826e9be96c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:30.788209 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a3d3b780-fb13-462f-ac85-14826e9be96c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:30.788961 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a3d3b780-fb13-462f-ac85-14826e9be96c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:30.789389 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a3d3b780-fb13-462f-ac85-14826e9be96c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:30.918184 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-a3d3b780-fb13-462f-ac85-14826e9be96c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:30.925975 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-a3d3b780-fb13-462f-ac85-14826e9be96c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:30.927520 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-a3d3b780-fb13-462f-ac85-14826e9be96c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:30.928704 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-a3d3b780-fb13-462f-ac85-14826e9be96c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1723 microversion: 2.20 time: 0.151314 Jun 27 09:38:30.929264 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 146/286] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:30 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:31.393400 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-2f08d638-47ba-45d4-a6bd-3ff8d40e5c1a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:31.393963 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-2f08d638-47ba-45d4-a6bd-3ff8d40e5c1a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:31.400443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2f08d638-47ba-45d4-a6bd-3ff8d40e5c1a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:31.400896 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2f08d638-47ba-45d4-a6bd-3ff8d40e5c1a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:31.401662 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2f08d638-47ba-45d4-a6bd-3ff8d40e5c1a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:31.402154 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2f08d638-47ba-45d4-a6bd-3ff8d40e5c1a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:31.538540 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-2f08d638-47ba-45d4-a6bd-3ff8d40e5c1a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:31.546542 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-2f08d638-47ba-45d4-a6bd-3ff8d40e5c1a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.157106 Jun 27 09:38:31.547114 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 141/287] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:31 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:31.946395 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-6ce70ad7-c827-4db8-a1c7-2f3d9dbc44e7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:31.947016 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-6ce70ad7-c827-4db8-a1c7-2f3d9dbc44e7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:31.953271 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6ce70ad7-c827-4db8-a1c7-2f3d9dbc44e7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:31.953718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6ce70ad7-c827-4db8-a1c7-2f3d9dbc44e7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:31.954501 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6ce70ad7-c827-4db8-a1c7-2f3d9dbc44e7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:31.954944 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6ce70ad7-c827-4db8-a1c7-2f3d9dbc44e7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:32.084203 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6ce70ad7-c827-4db8-a1c7-2f3d9dbc44e7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:32.092611 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6ce70ad7-c827-4db8-a1c7-2f3d9dbc44e7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:32.094125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6ce70ad7-c827-4db8-a1c7-2f3d9dbc44e7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:32.095279 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-6ce70ad7-c827-4db8-a1c7-2f3d9dbc44e7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1744 microversion: 2.20 time: 0.152915 Jun 27 09:38:32.095865 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 147/288] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:31 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:32.564077 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-cb87d8a9-3cca-4b8d-b3e3-8ff28bc2dfbf tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:32.564683 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-cb87d8a9-3cca-4b8d-b3e3-8ff28bc2dfbf tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:32.571126 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cb87d8a9-3cca-4b8d-b3e3-8ff28bc2dfbf tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:32.572455 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cb87d8a9-3cca-4b8d-b3e3-8ff28bc2dfbf tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:32.572846 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cb87d8a9-3cca-4b8d-b3e3-8ff28bc2dfbf tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:32.573278 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cb87d8a9-3cca-4b8d-b3e3-8ff28bc2dfbf tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:32.724845 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-cb87d8a9-3cca-4b8d-b3e3-8ff28bc2dfbf tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:32.732388 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-cb87d8a9-3cca-4b8d-b3e3-8ff28bc2dfbf tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.172138 Jun 27 09:38:32.733045 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 142/289] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:32 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:33.115177 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-50f77bfe-51c2-42fa-9a1b-d8e3c140abc0 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:33.115811 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-50f77bfe-51c2-42fa-9a1b-d8e3c140abc0 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:33.122807 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-50f77bfe-51c2-42fa-9a1b-d8e3c140abc0 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:33.123304 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-50f77bfe-51c2-42fa-9a1b-d8e3c140abc0 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:33.124108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-50f77bfe-51c2-42fa-9a1b-d8e3c140abc0 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:33.124552 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-50f77bfe-51c2-42fa-9a1b-d8e3c140abc0 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:33.265880 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-50f77bfe-51c2-42fa-9a1b-d8e3c140abc0 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:33.283696 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-50f77bfe-51c2-42fa-9a1b-d8e3c140abc0 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:33.285465 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-50f77bfe-51c2-42fa-9a1b-d8e3c140abc0 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:33.286919 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-50f77bfe-51c2-42fa-9a1b-d8e3c140abc0 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1744 microversion: 2.20 time: 0.175686 Jun 27 09:38:33.296175 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 148/290] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:33 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1744 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:33.749436 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-7d05ff2f-6d9b-4ff4-85cc-56ce44874f1c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:33.750084 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-7d05ff2f-6d9b-4ff4-85cc-56ce44874f1c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:33.756716 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7d05ff2f-6d9b-4ff4-85cc-56ce44874f1c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:33.757159 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7d05ff2f-6d9b-4ff4-85cc-56ce44874f1c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:33.757926 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7d05ff2f-6d9b-4ff4-85cc-56ce44874f1c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:33.758359 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7d05ff2f-6d9b-4ff4-85cc-56ce44874f1c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:33.890377 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-7d05ff2f-6d9b-4ff4-85cc-56ce44874f1c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:33.898007 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-7d05ff2f-6d9b-4ff4-85cc-56ce44874f1c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1501 microversion: 2.1 time: 0.152548 Jun 27 09:38:33.898574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 143/291] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:33 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:33.916852 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-2f3247c2-f1ed-47ab-ae4a-56a325a7494a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3358226-512d-4716-bba0-8bed4d3bd4c9"}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:38:33.917957 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-2f3247c2-f1ed-47ab-ae4a-56a325a7494a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:33.924487 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2f3247c2-f1ed-47ab-ae4a-56a325a7494a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:33.929378 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2f3247c2-f1ed-47ab-ae4a-56a325a7494a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:33.929378 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2f3247c2-f1ed-47ab-ae4a-56a325a7494a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:33.929378 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2f3247c2-f1ed-47ab-ae4a-56a325a7494a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:33.952357 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-2f3247c2-f1ed-47ab-ae4a-56a325a7494a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] HTTP exception thrown: Cannot 'attach_volume' instance 7744db71-f29c-4221-af51-e3688c4fbc97 while it is in vm_state rescued Jun 27 09:38:33.954040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-2f3247c2-f1ed-47ab-ae4a-56a325a7494a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Request method failure captured: Jun 27 09:38:33.954040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: POST /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97/os-volume_attachments HTTP/1.1 Jun 27 09:38:33.954040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:38:33.954040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:38:33.954040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:38:33.954040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 74 Jun 27 09:38:33.954040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:38:33.954040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:38:33.954040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:38:33.954040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:38:33.954040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXoPyTpqQqQHvEElWGjR7DZfAmEwMaudWgOazSbx2lM_fxgthBdxySIgz7_EK2myInpHOrYmO4EeBjzzrfGUjrdY5JcAdZnmqsf8z8_6nkg-QB70l4Rpm-gz_ByA_m8spfp5LU3dJlIbE7yw9ImfGdmloDzbo3Xb15bpRLxuPuS5CEY Jun 27 09:38:33.954040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:38:33.954040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:38:33.954040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:38:33.954040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:38:33.954040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:38:33.954040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:38:33.954040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: 6a50c1d09d3247728aa1ef9fb69463fc Jun 27 09:38:33.954040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1711375648 Jun 27 09:38:33.954040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:38:33.954040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:38:33.958388 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a50c1d09d3247728aa1ef9fb69463fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a50c1d09d3247728aa1ef9fb69463fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6a50c1d09d3247728aa1ef9fb69463fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6a50c1d09d3247728aa1ef9fb69463fc", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:38:33.958388 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1711375648 Jun 27 09:38:33.958388 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: 6a50c1d09d3247728aa1ef9fb69463fc Jun 27 09:38:33.958388 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1711375648 Jun 27 09:38:33.958388 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-ServerRescueNegativeTestJSON-1711375648-project Jun 27 09:38:33.958388 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:38:33.958388 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:38:33.958388 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: 41ce5cc7ff504d64aac73e48097a4b01 Jun 27 09:38:33.958388 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1711375648-project Jun 27 09:38:33.958388 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Jun 27 09:38:33.958388 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {"volumeAttachment": {"volumeId": "e3358226-512d-4716-bba0-8bed4d3bd4c9"}} Jun 27 09:38:33.958388 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: > Jun 27 09:38:33.959665 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Cannot 'attach_volume' instance 7744db71-f29c-4221-af51-e3688c4fbc97 while it is in vm_state rescued Jun 27 09:38:33.959665 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'server_id': '7744db71-f29c-4221-af51-e3688c4fbc97', 'body': {'volumeAttachment': {'volumeId': 'e3358226-512d-4716-bba0-8bed4d3bd4c9'}}} Jun 27 09:38:33.959665 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:38:33.959665 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:38:33.959665 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 27 09:38:33.959665 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 27 09:38:33.959665 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 09:38:33.959665 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 09:38:33.959665 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 27 09:38:33.959665 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 27 09:38:33.959665 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7744db71-f29c-4221-af51-e3688c4fbc97 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 27 09:38:33.959665 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:38:33.959665 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:38:33.959665 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:38:33.959665 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:38:33.959665 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:38:33.959665 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:38:33.959665 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:38:33.959665 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:38:33.960853 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:38:33.960853 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:38:33.960853 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 09:38:33.960853 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 09:38:33.960853 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 09:38:33.960853 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 09:38:33.960853 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 09:38:33.960853 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 09:38:33.960853 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 27 09:38:33.960853 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 27 09:38:33.960853 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 27 09:38:33.960853 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 27 09:38:33.960853 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7744db71-f29c-4221-af51-e3688c4fbc97 while it is in vm_state rescued Jun 27 09:38:33.960853 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:38:33.960853 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:38:33.960853 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:38:33.960853 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:38:33.960853 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:38:33.960853 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:38:33.962000 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:38:33.962000 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:38:33.962000 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7744db71-f29c-4221-af51-e3688c4fbc97 while it is in vm_state rescued Jun 27 09:38:33.962000 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:38:33.962000 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-2f3247c2-f1ed-47ab-ae4a-56a325a7494a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Returning 409 to user: Cannot 'attach_volume' instance 7744db71-f29c-4221-af51-e3688c4fbc97 while it is in vm_state rescued {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:38:33.962000 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-2f3247c2-f1ed-47ab-ae4a-56a325a7494a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "POST /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043677 Jun 27 09:38:33.962000 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 149/292] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 27 09:38:33 2022] POST /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 27 09:38:33.969047 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-f267c07e-54a4-4dd9-84c6-67ec56e01bb0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:38:33.975345 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-f267c07e-54a4-4dd9-84c6-67ec56e01bb0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:33.976448 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f267c07e-54a4-4dd9-84c6-67ec56e01bb0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:33.977086 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f267c07e-54a4-4dd9-84c6-67ec56e01bb0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:33.978123 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f267c07e-54a4-4dd9-84c6-67ec56e01bb0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:33.979072 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f267c07e-54a4-4dd9-84c6-67ec56e01bb0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:33.983753 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=100 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:38:34.261177 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-f267c07e-54a4-4dd9-84c6-67ec56e01bb0 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "POST /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97/action" status: 202 len: 0 microversion: 2.1 time: 0.295974 Jun 27 09:38:34.261814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 144/293] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 27 09:38:33 2022] POST /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:38:34.272578 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-cd320679-b60e-49cf-ba14-13b3d2cd419a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:34.274128 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-cd320679-b60e-49cf-ba14-13b3d2cd419a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:34.284140 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-cd320679-b60e-49cf-ba14-13b3d2cd419a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:34.286073 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-cd320679-b60e-49cf-ba14-13b3d2cd419a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:34.287324 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-cd320679-b60e-49cf-ba14-13b3d2cd419a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:34.288425 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-cd320679-b60e-49cf-ba14-13b3d2cd419a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:34.307975 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-eaa56ead-048c-46a2-8ab0-59e709e9218e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:34.308691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-eaa56ead-048c-46a2-8ab0-59e709e9218e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:34.320208 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-eaa56ead-048c-46a2-8ab0-59e709e9218e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:34.320661 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-eaa56ead-048c-46a2-8ab0-59e709e9218e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:34.321497 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-eaa56ead-048c-46a2-8ab0-59e709e9218e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:34.322088 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-eaa56ead-048c-46a2-8ab0-59e709e9218e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:34.490498 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-eaa56ead-048c-46a2-8ab0-59e709e9218e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:34.493894 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-cd320679-b60e-49cf-ba14-13b3d2cd419a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:34.503375 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-cd320679-b60e-49cf-ba14-13b3d2cd419a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1509 microversion: 2.1 time: 0.236896 Jun 27 09:38:34.505152 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-eaa56ead-048c-46a2-8ab0-59e709e9218e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:34.507212 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-eaa56ead-048c-46a2-8ab0-59e709e9218e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:34.507552 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 150/294] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:34 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1509 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:38:34.510000 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-eaa56ead-048c-46a2-8ab0-59e709e9218e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1739 microversion: 2.20 time: 0.206313 Jun 27 09:38:34.510717 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 145/295] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:34 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:35.377547 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-7ca28e99-c576-4cdb-b5ca-f4a96a126718 req-619c44dd-2b5d-4517-bfe6-aa22a9b0c2c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d72055f-6915-43b5-9831-61c2f134e60a", "name": "network-vif-plugged", "status": "completed", "tag": "a233eb88-dce4-49a8-9bf9-7a59a86e981b"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:38:35.394320 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-7ca28e99-c576-4cdb-b5ca-f4a96a126718 req-619c44dd-2b5d-4517-bfe6-aa22a9b0c2c4 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:35.395048 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-7ca28e99-c576-4cdb-b5ca-f4a96a126718 req-619c44dd-2b5d-4517-bfe6-aa22a9b0c2c4 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:35.425428 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-7ca28e99-c576-4cdb-b5ca-f4a96a126718 req-619c44dd-2b5d-4517-bfe6-aa22a9b0c2c4 service nova] Creating event network-vif-plugged:a233eb88-dce4-49a8-9bf9-7a59a86e981b for instance 1d72055f-6915-43b5-9831-61c2f134e60a on hv-cinder-84773 Jun 27 09:38:35.433736 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-7ca28e99-c576-4cdb-b5ca-f4a96a126718 req-619c44dd-2b5d-4517-bfe6-aa22a9b0c2c4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060204 Jun 27 09:38:35.435207 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 151/296] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:38:35.541532 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-1a894819-661e-478e-823f-2d07a34a95e4 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:35.542165 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-1a894819-661e-478e-823f-2d07a34a95e4 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:35.547652 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-d4699d94-8216-4a77-bebf-4e96f5dcf49c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:35.547652 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-d4699d94-8216-4a77-bebf-4e96f5dcf49c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:35.568599 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1a894819-661e-478e-823f-2d07a34a95e4 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:35.569050 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1a894819-661e-478e-823f-2d07a34a95e4 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:35.569828 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1a894819-661e-478e-823f-2d07a34a95e4 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:35.570265 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1a894819-661e-478e-823f-2d07a34a95e4 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:35.576381 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d4699d94-8216-4a77-bebf-4e96f5dcf49c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:35.576841 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d4699d94-8216-4a77-bebf-4e96f5dcf49c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:35.577662 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d4699d94-8216-4a77-bebf-4e96f5dcf49c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:35.578085 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d4699d94-8216-4a77-bebf-4e96f5dcf49c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:35.860002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-d4699d94-8216-4a77-bebf-4e96f5dcf49c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:35.869422 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-d4699d94-8216-4a77-bebf-4e96f5dcf49c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:35.876611 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-d4699d94-8216-4a77-bebf-4e96f5dcf49c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:35.877807 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-d4699d94-8216-4a77-bebf-4e96f5dcf49c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1739 microversion: 2.20 time: 0.353092 Jun 27 09:38:35.883392 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 152/297] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:35 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1739 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:35.919264 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-1a894819-661e-478e-823f-2d07a34a95e4 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:35.927228 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-1a894819-661e-478e-823f-2d07a34a95e4 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1509 microversion: 2.1 time: 0.405365 Jun 27 09:38:35.939237 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 146/298] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:35 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1509 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:36.902892 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-af86e9a4-db8d-42ab-b1c6-7de0d067af31 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:36.907371 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-af86e9a4-db8d-42ab-b1c6-7de0d067af31 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:36.909807 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-af86e9a4-db8d-42ab-b1c6-7de0d067af31 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:36.910271 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-af86e9a4-db8d-42ab-b1c6-7de0d067af31 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:36.911117 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-af86e9a4-db8d-42ab-b1c6-7de0d067af31 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:36.911753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-af86e9a4-db8d-42ab-b1c6-7de0d067af31 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:36.947255 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-4ebe4370-5a93-49cd-9a9c-3442a695dd58 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:36.952809 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-4ebe4370-5a93-49cd-9a9c-3442a695dd58 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:36.956422 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4ebe4370-5a93-49cd-9a9c-3442a695dd58 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:36.956926 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4ebe4370-5a93-49cd-9a9c-3442a695dd58 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:36.960270 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4ebe4370-5a93-49cd-9a9c-3442a695dd58 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:36.961033 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4ebe4370-5a93-49cd-9a9c-3442a695dd58 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:37.138419 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-af86e9a4-db8d-42ab-b1c6-7de0d067af31 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:37.152238 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-af86e9a4-db8d-42ab-b1c6-7de0d067af31 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:37.153855 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-af86e9a4-db8d-42ab-b1c6-7de0d067af31 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:37.154897 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-af86e9a4-db8d-42ab-b1c6-7de0d067af31 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1739 microversion: 2.20 time: 0.256575 Jun 27 09:38:37.165595 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 153/299] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:36 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1739 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:38:37.213244 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4ebe4370-5a93-49cd-9a9c-3442a695dd58 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:37.222117 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-4ebe4370-5a93-49cd-9a9c-3442a695dd58 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1509 microversion: 2.1 time: 0.279361 Jun 27 09:38:37.225564 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 147/300] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:36 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1509 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:38:38.173306 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e572a212-05f5-417f-84cd-ce054a6e5ba4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:38.174058 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-e572a212-05f5-417f-84cd-ce054a6e5ba4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:38.183864 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e572a212-05f5-417f-84cd-ce054a6e5ba4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:38.184399 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e572a212-05f5-417f-84cd-ce054a6e5ba4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:38.185724 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e572a212-05f5-417f-84cd-ce054a6e5ba4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:38.186451 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e572a212-05f5-417f-84cd-ce054a6e5ba4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:38.243185 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-18d46bbb-9c88-42f1-a6e3-e113314004f3 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:38.248175 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-18d46bbb-9c88-42f1-a6e3-e113314004f3 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:38.259431 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-18d46bbb-9c88-42f1-a6e3-e113314004f3 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:38.260015 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-18d46bbb-9c88-42f1-a6e3-e113314004f3 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:38.261062 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-18d46bbb-9c88-42f1-a6e3-e113314004f3 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:38.261855 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-18d46bbb-9c88-42f1-a6e3-e113314004f3 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:38.513364 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-18d46bbb-9c88-42f1-a6e3-e113314004f3 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:38.525276 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-18d46bbb-9c88-42f1-a6e3-e113314004f3 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1515 microversion: 2.1 time: 0.285658 Jun 27 09:38:38.526342 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 148/301] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:38 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1515 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:38.644396 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e572a212-05f5-417f-84cd-ce054a6e5ba4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:38.656748 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e572a212-05f5-417f-84cd-ce054a6e5ba4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:38.661165 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e572a212-05f5-417f-84cd-ce054a6e5ba4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:38.661165 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-e572a212-05f5-417f-84cd-ce054a6e5ba4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1739 microversion: 2.20 time: 0.491313 Jun 27 09:38:38.662236 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 154/302] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:38 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1739 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:39.680424 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-90d37a47-a51a-4e83-91af-eeb56a56360a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:39.680990 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-90d37a47-a51a-4e83-91af-eeb56a56360a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:39.683289 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=62 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:38:39.692826 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-90d37a47-a51a-4e83-91af-eeb56a56360a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:39.693269 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-90d37a47-a51a-4e83-91af-eeb56a56360a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:39.694021 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-90d37a47-a51a-4e83-91af-eeb56a56360a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:39.694448 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-90d37a47-a51a-4e83-91af-eeb56a56360a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:39.920804 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-90d37a47-a51a-4e83-91af-eeb56a56360a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:39.931270 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-90d37a47-a51a-4e83-91af-eeb56a56360a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:39.932963 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-90d37a47-a51a-4e83-91af-eeb56a56360a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:39.934393 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-90d37a47-a51a-4e83-91af-eeb56a56360a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1739 microversion: 2.20 time: 0.257919 Jun 27 09:38:39.944232 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 149/303] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:39 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1739 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:40.953861 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-510cd2bf-f645-4f3c-b4d4-65e907d36916 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:40.955210 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-510cd2bf-f645-4f3c-b4d4-65e907d36916 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:40.972702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-510cd2bf-f645-4f3c-b4d4-65e907d36916 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:40.972702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-510cd2bf-f645-4f3c-b4d4-65e907d36916 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:40.973415 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-510cd2bf-f645-4f3c-b4d4-65e907d36916 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:40.974036 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-510cd2bf-f645-4f3c-b4d4-65e907d36916 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:41.231592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-510cd2bf-f645-4f3c-b4d4-65e907d36916 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:41.268896 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-510cd2bf-f645-4f3c-b4d4-65e907d36916 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:41.273229 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-510cd2bf-f645-4f3c-b4d4-65e907d36916 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:41.279114 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-510cd2bf-f645-4f3c-b4d4-65e907d36916 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1739 microversion: 2.20 time: 0.324697 Jun 27 09:38:41.281723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 155/304] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:40 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1739 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:41.511907 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-20d11e59-d58a-40e8-8d43-80e831fc9daa tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Action: 'create', calling method: .version_select at 0x7ffa97638700>, body: {"keypair": {"name": "tempest-keypair-1718551329", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFH1Ms8GIl6o3RQajIo+8d/wIeU6OPR3MViqrP8uYqAZsbTj2TKEgtU62Jm8yqImc0rfedlL/h4Q8tqBQ3od0oY4DEWCJZIVTeAjfQ3qkK4Yq4SyJI4Wra0O2G75wMqC+Q=="}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:38:41.540423 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-20d11e59-d58a-40e8-8d43-80e831fc9daa tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Getting quotas for project 6a50c1d09d3247728aa1ef9fb69463fc. Resources: {'key_pairs'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:38:41.548351 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-20d11e59-d58a-40e8-8d43-80e831fc9daa tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Getting quotas for user 41ce5cc7ff504d64aac73e48097a4b01 and project 6a50c1d09d3247728aa1ef9fb69463fc. Resources: {'key_pairs'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:38:41.686287 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-20d11e59-d58a-40e8-8d43-80e831fc9daa tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.183080 Jun 27 09:38:41.693652 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 150/305] 10.222.0.64 () {60 vars in 1158 bytes} [Mon Jun 27 09:38:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:38:42.307865 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-8532d454-5c2f-4aa0-9e9a-1b05a01d9946 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:42.308628 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-8532d454-5c2f-4aa0-9e9a-1b05a01d9946 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:42.318415 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8532d454-5c2f-4aa0-9e9a-1b05a01d9946 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:42.318870 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8532d454-5c2f-4aa0-9e9a-1b05a01d9946 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:42.319687 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8532d454-5c2f-4aa0-9e9a-1b05a01d9946 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:42.320127 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8532d454-5c2f-4aa0-9e9a-1b05a01d9946 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:42.508500 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-49819b51-4c2a-415c-9a42-cf7b6fd227aa tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-83349129", "imageRef": "96dfa32c-d52f-4225-8918-743ebc97f4bc", "flavorRef": "452"}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:38:42.543802 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-8532d454-5c2f-4aa0-9e9a-1b05a01d9946 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:42.548392 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-8532d454-5c2f-4aa0-9e9a-1b05a01d9946 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:42.551828 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-8532d454-5c2f-4aa0-9e9a-1b05a01d9946 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:42.557805 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-8532d454-5c2f-4aa0-9e9a-1b05a01d9946 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1739 microversion: 2.20 time: 0.256692 Jun 27 09:38:42.570830 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 156/306] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:42 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1739 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:43.577763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-2084afe9-d541-4628-a635-c4cd702b5f08 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:43.582075 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-2084afe9-d541-4628-a635-c4cd702b5f08 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:43.594283 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2084afe9-d541-4628-a635-c4cd702b5f08 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:43.594737 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2084afe9-d541-4628-a635-c4cd702b5f08 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:43.595514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2084afe9-d541-4628-a635-c4cd702b5f08 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:43.596006 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2084afe9-d541-4628-a635-c4cd702b5f08 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:44.112649 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2084afe9-d541-4628-a635-c4cd702b5f08 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:44.124072 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2084afe9-d541-4628-a635-c4cd702b5f08 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:44.128970 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2084afe9-d541-4628-a635-c4cd702b5f08 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:44.130427 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-2084afe9-d541-4628-a635-c4cd702b5f08 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1739 microversion: 2.20 time: 0.556607 Jun 27 09:38:44.144986 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 157/307] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:43 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1739 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:38:44.521770 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-5ce3787f-6060-428c-a5c4-a5ebaefadefc tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-95107814", "imageRef": "96dfa32c-d52f-4225-8918-743ebc97f4bc", "flavorRef": "452", "networks": [{"uuid": "8dc842b0-c4e3-4553-aa78-54073ba34630"}]}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:38:49.588088 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.network.neutron [None req-49819b51-4c2a-415c-9a42-cf7b6fd227aa tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] validate_networks() for None {{(pid=124870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 09:38:49.604872 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.network.neutron [None req-5ce3787f-6060-428c-a5c4-a5ebaefadefc tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] validate_networks() for [('8dc842b0-c4e3-4553-aa78-54073ba34630', None, None, None, None, None)] {{(pid=124869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 09:38:49.929861 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:38:50.036852 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-49819b51-4c2a-415c-9a42-cf7b6fd227aa tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Flavor limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 09:38:50.046347 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-49819b51-4c2a-415c-9a42-cf7b6fd227aa tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Image limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 09:38:50.046347 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-49819b51-4c2a-415c-9a42-cf7b6fd227aa tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Flavor pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 09:38:50.046347 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-49819b51-4c2a-415c-9a42-cf7b6fd227aa tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Image pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 09:38:50.046347 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-49819b51-4c2a-415c-9a42-cf7b6fd227aa tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 09:38:50.062037 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-49819b51-4c2a-415c-9a42-cf7b6fd227aa tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:50.062263 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-49819b51-4c2a-415c-9a42-cf7b6fd227aa tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:50.064008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-49819b51-4c2a-415c-9a42-cf7b6fd227aa tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:50.064939 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-49819b51-4c2a-415c-9a42-cf7b6fd227aa tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:50.099671 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-49819b51-4c2a-415c-9a42-cf7b6fd227aa tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Getting quotas for project 0eb2a1214a1a4ae5a5211c18c2c39c1a. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:38:50.113769 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-49819b51-4c2a-415c-9a42-cf7b6fd227aa tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Getting quotas for user fdf2758dad91482ea5da6bfdb5896313 and project 0eb2a1214a1a4ae5a5211c18c2c39c1a. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:38:50.151221 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-49819b51-4c2a-415c-9a42-cf7b6fd227aa tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Going to run 1 instances... {{(pid=124870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 09:38:50.161655 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-49819b51-4c2a-415c-9a42-cf7b6fd227aa tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96dfa32c-d52f-4225-8918-743ebc97f4bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 09:38:50.374190 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-49819b51-4c2a-415c-9a42-cf7b6fd227aa tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.868548 Jun 27 09:38:50.378696 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 151/308] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 27 09:38:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 7875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 09:38:50.387259 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-9f0c9559-5432-4531-8d00-3cbfcc2f4780 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:50.392376 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-9f0c9559-5432-4531-8d00-3cbfcc2f4780 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:50.405023 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9f0c9559-5432-4531-8d00-3cbfcc2f4780 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:50.412533 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9f0c9559-5432-4531-8d00-3cbfcc2f4780 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:50.417446 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9f0c9559-5432-4531-8d00-3cbfcc2f4780 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:50.420741 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9f0c9559-5432-4531-8d00-3cbfcc2f4780 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:50.458983 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-5ce3787f-6060-428c-a5c4-a5ebaefadefc tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Flavor limits 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 09:38:50.459755 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-5ce3787f-6060-428c-a5c4-a5ebaefadefc tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Image limits 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 09:38:50.464646 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-5ce3787f-6060-428c-a5c4-a5ebaefadefc tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Flavor pref 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 09:38:50.464646 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-5ce3787f-6060-428c-a5c4-a5ebaefadefc tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Image pref 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 09:38:50.464646 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-5ce3787f-6060-428c-a5c4-a5ebaefadefc tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 09:38:50.466200 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=50 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:38:50.486821 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5ce3787f-6060-428c-a5c4-a5ebaefadefc tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:50.487629 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5ce3787f-6060-428c-a5c4-a5ebaefadefc tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:50.502386 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5ce3787f-6060-428c-a5c4-a5ebaefadefc tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:50.504353 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5ce3787f-6060-428c-a5c4-a5ebaefadefc tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:50.567149 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-5ce3787f-6060-428c-a5c4-a5ebaefadefc tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Getting quotas for project 604921be35cc4c258933114a5535800c. Resources: {'ram', 'instances', 'cores'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:38:50.586585 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-5ce3787f-6060-428c-a5c4-a5ebaefadefc tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Getting quotas for user 09f242a8f51545199a159f6992ee74f1 and project 604921be35cc4c258933114a5535800c. Resources: {'ram', 'instances', 'cores'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:38:50.627482 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-5ce3787f-6060-428c-a5c4-a5ebaefadefc tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Going to run 1 instances... {{(pid=124869) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 09:38:50.635505 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-5ce3787f-6060-428c-a5c4-a5ebaefadefc tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96dfa32c-d52f-4225-8918-743ebc97f4bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 09:38:50.736648 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-9f0c9559-5432-4531-8d00-3cbfcc2f4780 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:50.746021 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-9f0c9559-5432-4531-8d00-3cbfcc2f4780 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:50.753964 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-9f0c9559-5432-4531-8d00-3cbfcc2f4780 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:50.757902 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-9f0c9559-5432-4531-8d00-3cbfcc2f4780 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1739 microversion: 2.20 time: 0.379107 Jun 27 09:38:50.760475 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 152/309] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:50 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1739 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:50.770938 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e18be85e-1520-400d-84b2-8f18f4eb31e9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1372517902", "imageRef": "96dfa32c-d52f-4225-8918-743ebc97f4bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8135fe8c-03ea-49b7-8f4d-5a328bf8b692"}], "security_groups": [{"name": "tempest-securitygroup--1855664258"}], "key_name": "tempest-keypair-1718551329", "user_data": "}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:38:50.876989 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-5ce3787f-6060-428c-a5c4-a5ebaefadefc tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.359582 Jun 27 09:38:50.886148 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 158/310] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 27 09:38:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 6369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 09:38:50.896682 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-a98becb5-93dd-42f2-9860-a45529af5565 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:50.898805 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-a98becb5-93dd-42f2-9860-a45529af5565 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:51.029147 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.network.neutron [None req-e18be85e-1520-400d-84b2-8f18f4eb31e9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] validate_networks() for [('8135fe8c-03ea-49b7-8f4d-5a328bf8b692', None, None, None, None, None)] {{(pid=124870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 09:38:51.077269 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-a98becb5-93dd-42f2-9860-a45529af5565 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:51.085002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-a98becb5-93dd-42f2-9860-a45529af5565 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1213 microversion: 2.1 time: 0.196859 Jun 27 09:38:51.104514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 159/311] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:50 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1213 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:51.113187 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-6e80ef71-2636-4e2b-b19c-08af6f188fd4 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:51.113935 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-6e80ef71-2636-4e2b-b19c-08af6f188fd4 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:51.243343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6e80ef71-2636-4e2b-b19c-08af6f188fd4 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:51.254065 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-6e80ef71-2636-4e2b-b19c-08af6f188fd4 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1212 microversion: 2.1 time: 0.150465 Jun 27 09:38:51.263572 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 160/312] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:51 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1212 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:51.778289 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-01c91c14-4611-408b-baba-3ef503c17d3c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:51.783035 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-01c91c14-4611-408b-baba-3ef503c17d3c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:51.796373 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-01c91c14-4611-408b-baba-3ef503c17d3c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:51.809198 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-01c91c14-4611-408b-baba-3ef503c17d3c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:51.811155 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-01c91c14-4611-408b-baba-3ef503c17d3c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:51.814375 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-01c91c14-4611-408b-baba-3ef503c17d3c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:52.033618 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-01c91c14-4611-408b-baba-3ef503c17d3c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:52.060078 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-01c91c14-4611-408b-baba-3ef503c17d3c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:52.060078 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-01c91c14-4611-408b-baba-3ef503c17d3c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:52.060078 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-01c91c14-4611-408b-baba-3ef503c17d3c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1739 microversion: 2.20 time: 0.273002 Jun 27 09:38:52.060373 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 161/313] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:51 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1739 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:52.113310 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-dcaaa4a6-811a-4a5d-9712-0190dee0c0a8 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:52.113310 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-dcaaa4a6-811a-4a5d-9712-0190dee0c0a8 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:52.188558 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-dcaaa4a6-811a-4a5d-9712-0190dee0c0a8 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:52.196628 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-dcaaa4a6-811a-4a5d-9712-0190dee0c0a8 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1213 microversion: 2.1 time: 0.094584 Jun 27 09:38:52.212625 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 162/314] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:52 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1213 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:38:52.272869 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e8d1f7fc-1c06-411c-8588-bd3fab7a0502 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:52.273840 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-e8d1f7fc-1c06-411c-8588-bd3fab7a0502 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:52.348604 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-e18be85e-1520-400d-84b2-8f18f4eb31e9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Flavor limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 09:38:52.349101 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-e18be85e-1520-400d-84b2-8f18f4eb31e9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Image limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 09:38:52.349550 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-e18be85e-1520-400d-84b2-8f18f4eb31e9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Flavor pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 09:38:52.349954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-e18be85e-1520-400d-84b2-8f18f4eb31e9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Image pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 09:38:52.350423 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-e18be85e-1520-400d-84b2-8f18f4eb31e9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 09:38:52.362344 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e18be85e-1520-400d-84b2-8f18f4eb31e9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:52.362794 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e18be85e-1520-400d-84b2-8f18f4eb31e9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:52.366374 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e8d1f7fc-1c06-411c-8588-bd3fab7a0502 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:52.366648 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e18be85e-1520-400d-84b2-8f18f4eb31e9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:52.366648 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e18be85e-1520-400d-84b2-8f18f4eb31e9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:52.371810 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-e8d1f7fc-1c06-411c-8588-bd3fab7a0502 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1212 microversion: 2.1 time: 0.103507 Jun 27 09:38:52.372387 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 163/315] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:52 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1212 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:52.389444 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-e18be85e-1520-400d-84b2-8f18f4eb31e9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Getting quotas for project 6a50c1d09d3247728aa1ef9fb69463fc. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:38:52.393342 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-e18be85e-1520-400d-84b2-8f18f4eb31e9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Getting quotas for user 41ce5cc7ff504d64aac73e48097a4b01 and project 6a50c1d09d3247728aa1ef9fb69463fc. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:38:52.406158 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e18be85e-1520-400d-84b2-8f18f4eb31e9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Going to run 1 instances... {{(pid=124870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 09:38:52.408371 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e18be85e-1520-400d-84b2-8f18f4eb31e9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96dfa32c-d52f-4225-8918-743ebc97f4bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 09:38:52.558759 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e18be85e-1520-400d-84b2-8f18f4eb31e9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.794113 Jun 27 09:38:52.559415 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 153/316] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 27 09:38:50 2022] POST /compute/v2.1/servers => generated 409 bytes in 1798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 09:38:52.572062 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-16e58d02-458f-4f8d-959f-3881f7e94159 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:52.573006 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-16e58d02-458f-4f8d-959f-3881f7e94159 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:52.732197 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-16e58d02-458f-4f8d-959f-3881f7e94159 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:52.752277 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-16e58d02-458f-4f8d-959f-3881f7e94159 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1246 microversion: 2.1 time: 0.175433 Jun 27 09:38:52.761238 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 164/317] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:52 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1246 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:53.067160 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a0ca5ff4-6f30-4f68-9dd9-cb095a38292c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:53.069177 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-a0ca5ff4-6f30-4f68-9dd9-cb095a38292c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:53.078300 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a0ca5ff4-6f30-4f68-9dd9-cb095a38292c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:53.078765 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a0ca5ff4-6f30-4f68-9dd9-cb095a38292c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:53.079844 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a0ca5ff4-6f30-4f68-9dd9-cb095a38292c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:53.080298 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a0ca5ff4-6f30-4f68-9dd9-cb095a38292c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:53.217451 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-c6e1e75d-4191-452c-8354-74feef28178e tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:53.218053 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-c6e1e75d-4191-452c-8354-74feef28178e tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:53.231850 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c6e1e75d-4191-452c-8354-74feef28178e tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:53.233467 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c6e1e75d-4191-452c-8354-74feef28178e tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:53.233467 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c6e1e75d-4191-452c-8354-74feef28178e tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:53.233467 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c6e1e75d-4191-452c-8354-74feef28178e tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:53.311699 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-c6e1e75d-4191-452c-8354-74feef28178e tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:53.320495 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-c6e1e75d-4191-452c-8354-74feef28178e tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1265 microversion: 2.1 time: 0.107161 Jun 27 09:38:53.321769 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 165/318] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:53 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1265 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:38:53.328388 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a0ca5ff4-6f30-4f68-9dd9-cb095a38292c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:53.338473 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a0ca5ff4-6f30-4f68-9dd9-cb095a38292c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:53.340990 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a0ca5ff4-6f30-4f68-9dd9-cb095a38292c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:53.342351 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-a0ca5ff4-6f30-4f68-9dd9-cb095a38292c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1721 microversion: 2.20 time: 0.279668 Jun 27 09:38:53.343142 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 154/319] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:53 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1721 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:53.389602 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e80afe71-93ae-4c60-8e5b-daf78b76f855 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:53.390124 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-e80afe71-93ae-4c60-8e5b-daf78b76f855 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:53.397463 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e80afe71-93ae-4c60-8e5b-daf78b76f855 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:53.399741 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e80afe71-93ae-4c60-8e5b-daf78b76f855 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:53.399741 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e80afe71-93ae-4c60-8e5b-daf78b76f855 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:53.399741 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e80afe71-93ae-4c60-8e5b-daf78b76f855 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:53.483011 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e80afe71-93ae-4c60-8e5b-daf78b76f855 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:53.492308 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-e80afe71-93ae-4c60-8e5b-daf78b76f855 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1264 microversion: 2.1 time: 0.106438 Jun 27 09:38:53.494295 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 166/320] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:53 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1264 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:53.758251 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-7175e73e-01d0-4448-934f-4bd10e9d75ce tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:53.759012 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-7175e73e-01d0-4448-934f-4bd10e9d75ce tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:53.765962 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7175e73e-01d0-4448-934f-4bd10e9d75ce tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:53.766410 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7175e73e-01d0-4448-934f-4bd10e9d75ce tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:53.767455 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7175e73e-01d0-4448-934f-4bd10e9d75ce tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:53.771184 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7175e73e-01d0-4448-934f-4bd10e9d75ce tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:53.841110 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-7175e73e-01d0-4448-934f-4bd10e9d75ce tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:53.849452 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-7175e73e-01d0-4448-934f-4bd10e9d75ce tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1250 microversion: 2.1 time: 0.095009 Jun 27 09:38:53.855573 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 155/321] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:53 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1250 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:54.339619 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-ac50ba2d-fecd-48bf-9f56-a4099ef0a6f9 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:54.340513 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-ac50ba2d-fecd-48bf-9f56-a4099ef0a6f9 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:54.347264 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ac50ba2d-fecd-48bf-9f56-a4099ef0a6f9 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:54.348021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ac50ba2d-fecd-48bf-9f56-a4099ef0a6f9 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:54.349002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ac50ba2d-fecd-48bf-9f56-a4099ef0a6f9 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:54.349441 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ac50ba2d-fecd-48bf-9f56-a4099ef0a6f9 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:54.367695 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-f1c8521a-4bdd-4983-9d68-4bd2bdce66b9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:54.368549 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-f1c8521a-4bdd-4983-9d68-4bd2bdce66b9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:54.376239 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f1c8521a-4bdd-4983-9d68-4bd2bdce66b9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:54.376974 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f1c8521a-4bdd-4983-9d68-4bd2bdce66b9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:54.378090 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f1c8521a-4bdd-4983-9d68-4bd2bdce66b9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:54.378786 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f1c8521a-4bdd-4983-9d68-4bd2bdce66b9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:54.468338 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-ac50ba2d-fecd-48bf-9f56-a4099ef0a6f9 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:54.476343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-ac50ba2d-fecd-48bf-9f56-a4099ef0a6f9 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1265 microversion: 2.1 time: 0.141351 Jun 27 09:38:54.476914 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 167/322] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:54 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:54.510696 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-6dea1d4b-e97d-4620-b160-703c3d20722d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:54.511618 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-6dea1d4b-e97d-4620-b160-703c3d20722d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:54.517940 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6dea1d4b-e97d-4620-b160-703c3d20722d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:54.518626 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6dea1d4b-e97d-4620-b160-703c3d20722d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:54.519632 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6dea1d4b-e97d-4620-b160-703c3d20722d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:54.520287 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6dea1d4b-e97d-4620-b160-703c3d20722d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:54.538705 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=100 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:38:54.553162 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-f1c8521a-4bdd-4983-9d68-4bd2bdce66b9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:54.562943 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-f1c8521a-4bdd-4983-9d68-4bd2bdce66b9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:54.564708 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-f1c8521a-4bdd-4983-9d68-4bd2bdce66b9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:54.565942 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-f1c8521a-4bdd-4983-9d68-4bd2bdce66b9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1721 microversion: 2.20 time: 0.205006 Jun 27 09:38:54.566912 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 156/323] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:54 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:38:54.593017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6dea1d4b-e97d-4620-b160-703c3d20722d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:54.600636 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-6dea1d4b-e97d-4620-b160-703c3d20722d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1264 microversion: 2.1 time: 0.094227 Jun 27 09:38:54.601193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 168/324] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:54 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1264 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:38:54.870023 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-7e874155-d524-4b65-9275-0f40f5d7096b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:54.871215 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-7e874155-d524-4b65-9275-0f40f5d7096b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:54.877249 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7e874155-d524-4b65-9275-0f40f5d7096b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:54.878265 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7e874155-d524-4b65-9275-0f40f5d7096b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:54.878649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7e874155-d524-4b65-9275-0f40f5d7096b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:54.879096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7e874155-d524-4b65-9275-0f40f5d7096b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:54.947077 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-7e874155-d524-4b65-9275-0f40f5d7096b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:54.956669 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-7e874155-d524-4b65-9275-0f40f5d7096b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1250 microversion: 2.1 time: 0.090971 Jun 27 09:38:54.964519 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 157/325] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:54 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1250 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:55.475459 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-83c2753f-cfef-4960-86d9-26e291bda0e8 req-cc096175-d4a6-4d05-a745-00eae45901d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d72055f-6915-43b5-9831-61c2f134e60a", "name": "network-vif-unplugged", "status": "completed", "tag": "a233eb88-dce4-49a8-9bf9-7a59a86e981b"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:38:55.493583 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-3fc8d229-b832-44bc-a5aa-7f8959e91c7a tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:55.494460 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-3fc8d229-b832-44bc-a5aa-7f8959e91c7a tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:55.509721 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3fc8d229-b832-44bc-a5aa-7f8959e91c7a tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:55.510194 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3fc8d229-b832-44bc-a5aa-7f8959e91c7a tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:55.511017 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3fc8d229-b832-44bc-a5aa-7f8959e91c7a tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:55.511461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3fc8d229-b832-44bc-a5aa-7f8959e91c7a tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:55.517497 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-83c2753f-cfef-4960-86d9-26e291bda0e8 req-cc096175-d4a6-4d05-a745-00eae45901d1 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:55.517949 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-83c2753f-cfef-4960-86d9-26e291bda0e8 req-cc096175-d4a6-4d05-a745-00eae45901d1 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:55.603347 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-83c2753f-cfef-4960-86d9-26e291bda0e8 req-cc096175-d4a6-4d05-a745-00eae45901d1 service nova] Creating event network-vif-unplugged:a233eb88-dce4-49a8-9bf9-7a59a86e981b for instance 1d72055f-6915-43b5-9831-61c2f134e60a on hv-cinder-84773 Jun 27 09:38:55.616619 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-83c2753f-cfef-4960-86d9-26e291bda0e8 req-cc096175-d4a6-4d05-a745-00eae45901d1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154475 Jun 27 09:38:55.619086 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 169/326] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:38:55.633054 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-c753c602-88a5-4411-9bef-f5c07fc74f16 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:55.636495 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-c753c602-88a5-4411-9bef-f5c07fc74f16 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:55.662907 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c753c602-88a5-4411-9bef-f5c07fc74f16 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:55.669355 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c753c602-88a5-4411-9bef-f5c07fc74f16 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:55.670662 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c753c602-88a5-4411-9bef-f5c07fc74f16 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:55.671219 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c753c602-88a5-4411-9bef-f5c07fc74f16 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:55.811337 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-3fc8d229-b832-44bc-a5aa-7f8959e91c7a tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:55.829614 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-3fc8d229-b832-44bc-a5aa-7f8959e91c7a tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1273 microversion: 2.1 time: 0.339586 Jun 27 09:38:55.831672 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 158/327] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:55 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1273 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:38:55.842907 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-6f400450-d5eb-4140-847b-e5e5f8930138 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:55.843594 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-6f400450-d5eb-4140-847b-e5e5f8930138 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:55.850839 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6f400450-d5eb-4140-847b-e5e5f8930138 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:55.853407 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6f400450-d5eb-4140-847b-e5e5f8930138 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:55.854651 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6f400450-d5eb-4140-847b-e5e5f8930138 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:55.855252 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6f400450-d5eb-4140-847b-e5e5f8930138 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:55.984157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-6f400450-d5eb-4140-847b-e5e5f8930138 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:55.992962 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-6f400450-d5eb-4140-847b-e5e5f8930138 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1264 microversion: 2.1 time: 0.159998 Jun 27 09:38:55.994228 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 159/328] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:55 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:56.000372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-6f5540ef-1322-413b-b66a-8a93cbc5369d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:56.001599 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-6f5540ef-1322-413b-b66a-8a93cbc5369d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:56.019552 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6f5540ef-1322-413b-b66a-8a93cbc5369d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:56.020012 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6f5540ef-1322-413b-b66a-8a93cbc5369d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:56.024672 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6f5540ef-1322-413b-b66a-8a93cbc5369d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:56.024672 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6f5540ef-1322-413b-b66a-8a93cbc5369d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:56.106891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-6f5540ef-1322-413b-b66a-8a93cbc5369d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:56.115050 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-6f5540ef-1322-413b-b66a-8a93cbc5369d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1298 microversion: 2.1 time: 0.119537 Jun 27 09:38:56.115933 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 160/329] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:55 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1298 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:56.565156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-c753c602-88a5-4411-9bef-f5c07fc74f16 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:56.575133 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-c753c602-88a5-4411-9bef-f5c07fc74f16 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:56.576974 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-c753c602-88a5-4411-9bef-f5c07fc74f16 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:56.578318 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-c753c602-88a5-4411-9bef-f5c07fc74f16 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1724 microversion: 2.20 time: 0.957839 Jun 27 09:38:56.589653 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 170/330] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:55 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1724 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:38:56.596868 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-1f07e7af-d813-4bf0-9d33-cc1a1e1d7e77 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e10005c3-859a-4af5-b201-5b90e6813df5"}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:38:56.598256 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-1f07e7af-d813-4bf0-9d33-cc1a1e1d7e77 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:56.605705 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1f07e7af-d813-4bf0-9d33-cc1a1e1d7e77 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:56.606412 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1f07e7af-d813-4bf0-9d33-cc1a1e1d7e77 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:56.607354 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1f07e7af-d813-4bf0-9d33-cc1a1e1d7e77 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:56.607971 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1f07e7af-d813-4bf0-9d33-cc1a1e1d7e77 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:56.847261 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-ed5cc2e9-0b01-47ab-a4dc-b379b4d90d0a tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:56.847896 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-ed5cc2e9-0b01-47ab-a4dc-b379b4d90d0a tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:56.856827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ed5cc2e9-0b01-47ab-a4dc-b379b4d90d0a tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:56.857292 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ed5cc2e9-0b01-47ab-a4dc-b379b4d90d0a tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:56.858068 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ed5cc2e9-0b01-47ab-a4dc-b379b4d90d0a tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:56.863939 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ed5cc2e9-0b01-47ab-a4dc-b379b4d90d0a tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:57.176031 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-ed5cc2e9-0b01-47ab-a4dc-b379b4d90d0a tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:57.183830 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-ed5cc2e9-0b01-47ab-a4dc-b379b4d90d0a tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1271 microversion: 2.1 time: 0.340167 Jun 27 09:38:57.184476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 171/331] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:56 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1271 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:57.194282 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-dcef74ce-4be1-452d-a56d-885459d3e722 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:57.194282 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-dcef74ce-4be1-452d-a56d-885459d3e722 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:57.202083 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dcef74ce-4be1-452d-a56d-885459d3e722 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:57.202083 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dcef74ce-4be1-452d-a56d-885459d3e722 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:57.202083 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dcef74ce-4be1-452d-a56d-885459d3e722 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:57.202083 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dcef74ce-4be1-452d-a56d-885459d3e722 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:57.283386 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-dcef74ce-4be1-452d-a56d-885459d3e722 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:57.296252 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-dcef74ce-4be1-452d-a56d-885459d3e722 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1270 microversion: 2.1 time: 0.110378 Jun 27 09:38:57.297060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 172/332] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:57 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1270 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:57.309396 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-99d8fbd6-92ec-494a-8af8-06e2e58e68cd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:57.310436 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-99d8fbd6-92ec-494a-8af8-06e2e58e68cd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:57.316735 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-99d8fbd6-92ec-494a-8af8-06e2e58e68cd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:57.317180 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-99d8fbd6-92ec-494a-8af8-06e2e58e68cd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:57.317952 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-99d8fbd6-92ec-494a-8af8-06e2e58e68cd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:57.318391 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-99d8fbd6-92ec-494a-8af8-06e2e58e68cd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:57.482950 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-99d8fbd6-92ec-494a-8af8-06e2e58e68cd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:57.492225 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-99d8fbd6-92ec-494a-8af8-06e2e58e68cd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1304 microversion: 2.1 time: 0.186259 Jun 27 09:38:57.497044 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 173/333] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:57 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1304 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:57.998361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-1f07e7af-d813-4bf0-9d33-cc1a1e1d7e77 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "POST /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.405435 Jun 27 09:38:57.998974 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 161/334] 10.222.0.64 () {62 vars in 1363 bytes} [Mon Jun 27 09:38:56 2022] POST /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a/os-volume_attachments => generated 188 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 09:38:58.213664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-a0a4d6df-d926-4589-aa03-f83b295fee6b tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:58.213664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-a0a4d6df-d926-4589-aa03-f83b295fee6b tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:58.231642 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a0a4d6df-d926-4589-aa03-f83b295fee6b tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:58.233599 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a0a4d6df-d926-4589-aa03-f83b295fee6b tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:58.236336 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a0a4d6df-d926-4589-aa03-f83b295fee6b tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:58.236336 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a0a4d6df-d926-4589-aa03-f83b295fee6b tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:58.299438 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-db8ff7c8-94c8-49d7-88a1-a9b217a8383c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:38:58.300037 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-db8ff7c8-94c8-49d7-88a1-a9b217a8383c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:58.318854 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-db8ff7c8-94c8-49d7-88a1-a9b217a8383c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:58.322979 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-db8ff7c8-94c8-49d7-88a1-a9b217a8383c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:58.323998 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-db8ff7c8-94c8-49d7-88a1-a9b217a8383c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:58.324509 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-db8ff7c8-94c8-49d7-88a1-a9b217a8383c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:58.357895 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-a0a4d6df-d926-4589-aa03-f83b295fee6b tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:58.368399 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-a0a4d6df-d926-4589-aa03-f83b295fee6b tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1271 microversion: 2.1 time: 0.162879 Jun 27 09:38:58.369111 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 174/335] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:58 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:58.380151 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-9f01fb24-cd1a-42de-9418-c2ffbd8bec4b tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:58.380151 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-9f01fb24-cd1a-42de-9418-c2ffbd8bec4b tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:58.398331 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9f01fb24-cd1a-42de-9418-c2ffbd8bec4b tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:58.399470 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9f01fb24-cd1a-42de-9418-c2ffbd8bec4b tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:58.401492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9f01fb24-cd1a-42de-9418-c2ffbd8bec4b tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:58.401978 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9f01fb24-cd1a-42de-9418-c2ffbd8bec4b tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:58.736422 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-db8ff7c8-94c8-49d7-88a1-a9b217a8383c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "POST /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a/action" status: 202 len: 0 microversion: 2.20 time: 0.441330 Jun 27 09:38:58.742021 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 162/336] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jun 27 09:38:58 2022] POST /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a/action => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 09:38:58.754810 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-4d633e05-30a8-4349-ba76-de1528deac22 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:58.755438 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-4d633e05-30a8-4349-ba76-de1528deac22 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:58.768088 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4d633e05-30a8-4349-ba76-de1528deac22 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:58.768543 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4d633e05-30a8-4349-ba76-de1528deac22 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:58.772387 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4d633e05-30a8-4349-ba76-de1528deac22 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:58.772387 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4d633e05-30a8-4349-ba76-de1528deac22 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:58.990866 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-9f01fb24-cd1a-42de-9418-c2ffbd8bec4b tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:58.999331 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-9f01fb24-cd1a-42de-9418-c2ffbd8bec4b tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1312 microversion: 2.1 time: 0.627960 Jun 27 09:38:59.003860 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 175/337] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:58 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1312 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:59.021281 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-90059223-fa05-4b66-b2e9-e35681e39632 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:59.021281 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-90059223-fa05-4b66-b2e9-e35681e39632 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:59.029109 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-90059223-fa05-4b66-b2e9-e35681e39632 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:59.029565 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-90059223-fa05-4b66-b2e9-e35681e39632 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:59.034341 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-90059223-fa05-4b66-b2e9-e35681e39632 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:59.034845 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-90059223-fa05-4b66-b2e9-e35681e39632 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:59.097377 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4d633e05-30a8-4349-ba76-de1528deac22 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:59.110275 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-4d633e05-30a8-4349-ba76-de1528deac22 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1372 microversion: 2.1 time: 0.365235 Jun 27 09:38:59.111431 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 163/338] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:58 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1372 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:59.387061 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-2508f884-40d7-4694-8a5f-2c53d9ffcf8c tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:38:59.388079 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-2508f884-40d7-4694-8a5f-2c53d9ffcf8c tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:38:59.410233 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2508f884-40d7-4694-8a5f-2c53d9ffcf8c tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:59.410961 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2508f884-40d7-4694-8a5f-2c53d9ffcf8c tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:59.412029 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2508f884-40d7-4694-8a5f-2c53d9ffcf8c tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:38:59.412640 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2508f884-40d7-4694-8a5f-2c53d9ffcf8c tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:38:59.869015 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-2508f884-40d7-4694-8a5f-2c53d9ffcf8c tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:59.878071 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-2508f884-40d7-4694-8a5f-2c53d9ffcf8c tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1313 microversion: 2.1 time: 0.495935 Jun 27 09:38:59.885500 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 164/339] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:38:59 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1313 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:38:59.919956 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-90059223-fa05-4b66-b2e9-e35681e39632 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:59.937929 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-90059223-fa05-4b66-b2e9-e35681e39632 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:59.939463 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-90059223-fa05-4b66-b2e9-e35681e39632 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:38:59.940679 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-90059223-fa05-4b66-b2e9-e35681e39632 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1750 microversion: 2.20 time: 0.935628 Jun 27 09:38:59.941241 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 176/340] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:38:59 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1750 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:00.023319 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-4ffc0678-34f2-4f5b-a218-0e6d0f20de1c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:00.024532 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-4ffc0678-34f2-4f5b-a218-0e6d0f20de1c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:00.039214 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4ffc0678-34f2-4f5b-a218-0e6d0f20de1c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:00.040257 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4ffc0678-34f2-4f5b-a218-0e6d0f20de1c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:00.041530 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4ffc0678-34f2-4f5b-a218-0e6d0f20de1c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:00.041965 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4ffc0678-34f2-4f5b-a218-0e6d0f20de1c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:00.113559 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:00.128683 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-85b1a373-9465-45aa-a6a9-6c80ab8e5bff tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:00.129268 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-85b1a373-9465-45aa-a6a9-6c80ab8e5bff tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:00.155084 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-85b1a373-9465-45aa-a6a9-6c80ab8e5bff tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:00.155561 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-85b1a373-9465-45aa-a6a9-6c80ab8e5bff tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:00.160555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-85b1a373-9465-45aa-a6a9-6c80ab8e5bff tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:00.167856 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-85b1a373-9465-45aa-a6a9-6c80ab8e5bff tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:00.540008 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell0:SELECT=2 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:00.654866 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4ffc0678-34f2-4f5b-a218-0e6d0f20de1c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:00.668417 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-4ffc0678-34f2-4f5b-a218-0e6d0f20de1c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1312 microversion: 2.1 time: 0.649890 Jun 27 09:39:00.677970 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 165/341] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:00 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1312 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:00.687323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-bbb322c7-24c2-4c35-88c7-6aaa61ab7583 req-70ddca7d-783b-4b74-94db-c7b2aec99ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3", "tag": "b082c8ad-e4de-4a60-b4fe-8c92c80f4c32"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:00.711759 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-bbb322c7-24c2-4c35-88c7-6aaa61ab7583 req-70ddca7d-783b-4b74-94db-c7b2aec99ee9 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:00.712214 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-bbb322c7-24c2-4c35-88c7-6aaa61ab7583 req-70ddca7d-783b-4b74-94db-c7b2aec99ee9 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:00.765273 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-bbb322c7-24c2-4c35-88c7-6aaa61ab7583 req-70ddca7d-783b-4b74-94db-c7b2aec99ee9 service nova] Creating event network-changed:b082c8ad-e4de-4a60-b4fe-8c92c80f4c32 for instance bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 on hv-cinder-84773 Jun 27 09:39:00.778001 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-bbb322c7-24c2-4c35-88c7-6aaa61ab7583 req-70ddca7d-783b-4b74-94db-c7b2aec99ee9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106209 Jun 27 09:39:00.779168 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 166/342] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:39:00.801324 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-85b1a373-9465-45aa-a6a9-6c80ab8e5bff tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:00.824646 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-85b1a373-9465-45aa-a6a9-6c80ab8e5bff tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1372 microversion: 2.1 time: 0.699915 Jun 27 09:39:00.834310 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 177/343] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:00 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1372 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:00.902808 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-930c447b-b1a1-4617-a238-3eeee4869b3d tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:00.903636 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-930c447b-b1a1-4617-a238-3eeee4869b3d tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:00.915703 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-930c447b-b1a1-4617-a238-3eeee4869b3d tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:00.916510 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-930c447b-b1a1-4617-a238-3eeee4869b3d tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:00.920359 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-930c447b-b1a1-4617-a238-3eeee4869b3d tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:00.920889 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-930c447b-b1a1-4617-a238-3eeee4869b3d tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:00.958105 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f46f04f9-2374-46ac-a072-c72da5bf028b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:00.959556 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-f46f04f9-2374-46ac-a072-c72da5bf028b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:00.969954 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f46f04f9-2374-46ac-a072-c72da5bf028b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:00.970404 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f46f04f9-2374-46ac-a072-c72da5bf028b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:00.971177 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f46f04f9-2374-46ac-a072-c72da5bf028b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:00.971665 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f46f04f9-2374-46ac-a072-c72da5bf028b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:01.899279 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-930c447b-b1a1-4617-a238-3eeee4869b3d tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:01.913096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-930c447b-b1a1-4617-a238-3eeee4869b3d tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1313 microversion: 2.1 time: 1.015790 Jun 27 09:39:01.914896 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 167/344] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:00 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1313 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:01.927646 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-df3686d5-ad7c-4a41-8258-abdf21c2b4ae tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:01.928157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-df3686d5-ad7c-4a41-8258-abdf21c2b4ae tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:01.936532 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-df3686d5-ad7c-4a41-8258-abdf21c2b4ae tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:01.937275 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-df3686d5-ad7c-4a41-8258-abdf21c2b4ae tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:01.938293 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-df3686d5-ad7c-4a41-8258-abdf21c2b4ae tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:01.939497 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-df3686d5-ad7c-4a41-8258-abdf21c2b4ae tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:02.003848 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-df3686d5-ad7c-4a41-8258-abdf21c2b4ae tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2/ips" status: 200 len: 150 microversion: 2.1 time: 0.086996 Jun 27 09:39:02.004443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 168/345] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jun 27 09:39:01 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2/ips => generated 150 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:39:02.025859 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f46f04f9-2374-46ac-a072-c72da5bf028b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:02.034948 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-3672395f-2719-4bca-a7c6-d7414eabb63d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:02.035681 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-3672395f-2719-4bca-a7c6-d7414eabb63d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:02.041688 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f46f04f9-2374-46ac-a072-c72da5bf028b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:02.048418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f46f04f9-2374-46ac-a072-c72da5bf028b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:02.051453 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-f46f04f9-2374-46ac-a072-c72da5bf028b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1750 microversion: 2.20 time: 1.095593 Jun 27 09:39:02.053640 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 178/346] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:00 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1750 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:02.058711 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3672395f-2719-4bca-a7c6-d7414eabb63d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:02.059169 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3672395f-2719-4bca-a7c6-d7414eabb63d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:02.060088 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3672395f-2719-4bca-a7c6-d7414eabb63d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:02.060533 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3672395f-2719-4bca-a7c6-d7414eabb63d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:02.067712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-2bd1ab64-c90f-41ac-86ea-81e64dc86429 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:02.068364 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-2bd1ab64-c90f-41ac-86ea-81e64dc86429 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:02.078346 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2bd1ab64-c90f-41ac-86ea-81e64dc86429 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:02.079202 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2bd1ab64-c90f-41ac-86ea-81e64dc86429 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:02.081657 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2bd1ab64-c90f-41ac-86ea-81e64dc86429 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:02.082394 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2bd1ab64-c90f-41ac-86ea-81e64dc86429 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:02.377116 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-3672395f-2719-4bca-a7c6-d7414eabb63d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:02.384305 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=4 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:02.396081 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-3672395f-2719-4bca-a7c6-d7414eabb63d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1312 microversion: 2.1 time: 0.371332 Jun 27 09:39:02.397448 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 169/347] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:02 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1312 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:02.403266 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=16 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:02.410231 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-7159a5ce-7ab4-4794-b2a9-d266ab3dbba8 req-d5a54440-1322-44f8-b749-df56d20a5f9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "150e9347-3eae-4d8c-8b7e-24ac9f867f1f", "tag": "d213adbe-5b3f-4aea-a20c-fc98a6690d24"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:02.441656 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-7159a5ce-7ab4-4794-b2a9-d266ab3dbba8 req-d5a54440-1322-44f8-b749-df56d20a5f9a service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:02.442284 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-7159a5ce-7ab4-4794-b2a9-d266ab3dbba8 req-d5a54440-1322-44f8-b749-df56d20a5f9a service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:02.457433 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-7159a5ce-7ab4-4794-b2a9-d266ab3dbba8 req-d5a54440-1322-44f8-b749-df56d20a5f9a service nova] Creating event network-changed:d213adbe-5b3f-4aea-a20c-fc98a6690d24 for instance 150e9347-3eae-4d8c-8b7e-24ac9f867f1f on hv-cinder-84773 Jun 27 09:39:02.465625 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-7159a5ce-7ab4-4794-b2a9-d266ab3dbba8 req-d5a54440-1322-44f8-b749-df56d20a5f9a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066578 Jun 27 09:39:02.466524 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 170/348] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:39:02.523312 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2bd1ab64-c90f-41ac-86ea-81e64dc86429 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:02.540889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-2bd1ab64-c90f-41ac-86ea-81e64dc86429 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1372 microversion: 2.1 time: 0.482381 Jun 27 09:39:02.568320 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 179/349] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:02 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1372 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:02.934872 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-47354896-aaa8-42db-9bfb-3adf6fb7e8c4 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:02.935609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-47354896-aaa8-42db-9bfb-3adf6fb7e8c4 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:02.954521 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-47354896-aaa8-42db-9bfb-3adf6fb7e8c4 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:02.955026 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-47354896-aaa8-42db-9bfb-3adf6fb7e8c4 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:02.958648 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-47354896-aaa8-42db-9bfb-3adf6fb7e8c4 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:02.959108 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-47354896-aaa8-42db-9bfb-3adf6fb7e8c4 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:03.077571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-93f2594a-79b4-49db-9a7e-7aebf726d629 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:03.078116 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-93f2594a-79b4-49db-9a7e-7aebf726d629 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:03.103471 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell0:SELECT=16 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:03.116034 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-93f2594a-79b4-49db-9a7e-7aebf726d629 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:03.123501 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-93f2594a-79b4-49db-9a7e-7aebf726d629 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:03.124469 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-93f2594a-79b4-49db-9a7e-7aebf726d629 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:03.127115 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-93f2594a-79b4-49db-9a7e-7aebf726d629 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:04.074150 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-47354896-aaa8-42db-9bfb-3adf6fb7e8c4 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:04.094965 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-47354896-aaa8-42db-9bfb-3adf6fb7e8c4 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1313 microversion: 2.1 time: 1.156776 Jun 27 09:39:04.102196 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 171/350] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:02 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1313 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:04.119643 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-d9f892c5-764c-468b-af89-c821648f49d3 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:04.120333 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-d9f892c5-764c-468b-af89-c821648f49d3 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:04.145504 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d9f892c5-764c-468b-af89-c821648f49d3 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:04.145973 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d9f892c5-764c-468b-af89-c821648f49d3 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:04.163596 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d9f892c5-764c-468b-af89-c821648f49d3 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:04.163596 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d9f892c5-764c-468b-af89-c821648f49d3 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:04.186103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-93f2594a-79b4-49db-9a7e-7aebf726d629 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:04.199470 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-93f2594a-79b4-49db-9a7e-7aebf726d629 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:04.203688 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-93f2594a-79b4-49db-9a7e-7aebf726d629 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:04.208642 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-93f2594a-79b4-49db-9a7e-7aebf726d629 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1752 microversion: 2.20 time: 1.138783 Jun 27 09:39:04.210334 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 180/351] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:03 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1752 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:04.230000 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-ad544559-3e90-498b-828a-7c30b2507a14 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:04.231950 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-ad544559-3e90-498b-828a-7c30b2507a14 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:04.246315 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ad544559-3e90-498b-828a-7c30b2507a14 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:04.248290 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ad544559-3e90-498b-828a-7c30b2507a14 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:04.249368 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ad544559-3e90-498b-828a-7c30b2507a14 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:04.250788 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ad544559-3e90-498b-828a-7c30b2507a14 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:04.718186 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-ad544559-3e90-498b-828a-7c30b2507a14 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:04.728661 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-ad544559-3e90-498b-828a-7c30b2507a14 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1372 microversion: 2.1 time: 0.515253 Jun 27 09:39:04.729677 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 181/352] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:04 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1372 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:04.735163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-85f0577d-c04f-4c1c-b0c6-a352fddbb346 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73d849d8-5ad9-49fb-bef8-123399e09e06"}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:04.736935 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-85f0577d-c04f-4c1c-b0c6-a352fddbb346 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:04.750820 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-85f0577d-c04f-4c1c-b0c6-a352fddbb346 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:04.754956 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-85f0577d-c04f-4c1c-b0c6-a352fddbb346 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:04.754956 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-85f0577d-c04f-4c1c-b0c6-a352fddbb346 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:04.754956 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-85f0577d-c04f-4c1c-b0c6-a352fddbb346 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:04.825541 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d9f892c5-764c-468b-af89-c821648f49d3 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:04.836108 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-d9f892c5-764c-468b-af89-c821648f49d3 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1312 microversion: 2.1 time: 0.734946 Jun 27 09:39:04.836693 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 172/353] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:04 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1312 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:04.845053 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-dfd1de5d-84e8-45e9-8aaf-3174f6f906c5 req-bb428f43-3e26-4dde-b5fc-cb5f0eb8347c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45393090-60ab-4485-af6c-8e4f8fbbfef4", "tag": "1efbdb28-4c1d-4e61-be86-3eade588e95d"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:04.849828 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-dfd1de5d-84e8-45e9-8aaf-3174f6f906c5 req-bb428f43-3e26-4dde-b5fc-cb5f0eb8347c service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:04.855623 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-dfd1de5d-84e8-45e9-8aaf-3174f6f906c5 req-bb428f43-3e26-4dde-b5fc-cb5f0eb8347c service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:04.870681 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-dfd1de5d-84e8-45e9-8aaf-3174f6f906c5 req-bb428f43-3e26-4dde-b5fc-cb5f0eb8347c service nova] Creating event network-changed:1efbdb28-4c1d-4e61-be86-3eade588e95d for instance 45393090-60ab-4485-af6c-8e4f8fbbfef4 on hv-cinder-84773 Jun 27 09:39:04.878606 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-dfd1de5d-84e8-45e9-8aaf-3174f6f906c5 req-bb428f43-3e26-4dde-b5fc-cb5f0eb8347c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038513 Jun 27 09:39:04.878606 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 173/354] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:39:05.117898 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-3eac5214-71d7-4dcc-85d8-00d36c549c0e tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:05.118784 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-3eac5214-71d7-4dcc-85d8-00d36c549c0e tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:05.125632 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3eac5214-71d7-4dcc-85d8-00d36c549c0e tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:05.127270 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3eac5214-71d7-4dcc-85d8-00d36c549c0e tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:05.127270 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3eac5214-71d7-4dcc-85d8-00d36c549c0e tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:05.127270 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3eac5214-71d7-4dcc-85d8-00d36c549c0e tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:05.264293 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-3eac5214-71d7-4dcc-85d8-00d36c549c0e tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:05.272334 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-3eac5214-71d7-4dcc-85d8-00d36c549c0e tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1313 microversion: 2.1 time: 0.159242 Jun 27 09:39:05.272960 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 174/355] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:05 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:05.278078 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-8533816d-2146-4e5a-bd4e-1fe8f39b0c4c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:05.278801 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-8533816d-2146-4e5a-bd4e-1fe8f39b0c4c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:05.285345 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8533816d-2146-4e5a-bd4e-1fe8f39b0c4c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:05.285858 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8533816d-2146-4e5a-bd4e-1fe8f39b0c4c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:05.286876 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8533816d-2146-4e5a-bd4e-1fe8f39b0c4c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:05.287342 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8533816d-2146-4e5a-bd4e-1fe8f39b0c4c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:05.421078 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8533816d-2146-4e5a-bd4e-1fe8f39b0c4c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:05.429993 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8533816d-2146-4e5a-bd4e-1fe8f39b0c4c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:05.431479 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8533816d-2146-4e5a-bd4e-1fe8f39b0c4c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:05.432703 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-8533816d-2146-4e5a-bd4e-1fe8f39b0c4c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1752 microversion: 2.20 time: 0.158298 Jun 27 09:39:05.433276 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 175/356] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:05 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:05.749938 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-0d626958-a9b7-43e1-aac0-dae1f659c3ff tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:05.750663 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-0d626958-a9b7-43e1-aac0-dae1f659c3ff tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:05.774824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0d626958-a9b7-43e1-aac0-dae1f659c3ff tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:05.775898 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0d626958-a9b7-43e1-aac0-dae1f659c3ff tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:05.782270 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0d626958-a9b7-43e1-aac0-dae1f659c3ff tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:05.785122 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0d626958-a9b7-43e1-aac0-dae1f659c3ff tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:06.297662 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-0d626958-a9b7-43e1-aac0-dae1f659c3ff tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:06.314287 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-0d626958-a9b7-43e1-aac0-dae1f659c3ff tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1372 microversion: 2.1 time: 0.572668 Jun 27 09:39:06.316166 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 176/357] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:05 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1372 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:06.322297 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-1289a410-4f29-4f61-bb52-2bf777306313 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:06.322910 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-1289a410-4f29-4f61-bb52-2bf777306313 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:06.332713 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1289a410-4f29-4f61-bb52-2bf777306313 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:06.333715 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1289a410-4f29-4f61-bb52-2bf777306313 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:06.335164 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1289a410-4f29-4f61-bb52-2bf777306313 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:06.335711 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1289a410-4f29-4f61-bb52-2bf777306313 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:06.425800 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-85f0577d-c04f-4c1c-b0c6-a352fddbb346 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "POST /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.694935 Jun 27 09:39:06.426920 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 182/358] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 27 09:39:04 2022] POST /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2/os-volume_attachments => generated 194 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:39:06.437810 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-57d67eb9-18db-4626-8dfd-d25a0b481d14 req-bc39258c-138e-4002-bca2-5b6f0c778088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3", "name": "network-vif-plugged", "status": "completed", "tag": "b082c8ad-e4de-4a60-b4fe-8c92c80f4c32"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:06.459621 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-57d67eb9-18db-4626-8dfd-d25a0b481d14 req-bc39258c-138e-4002-bca2-5b6f0c778088 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:06.460790 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-57d67eb9-18db-4626-8dfd-d25a0b481d14 req-bc39258c-138e-4002-bca2-5b6f0c778088 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:06.473974 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-57d67eb9-18db-4626-8dfd-d25a0b481d14 req-bc39258c-138e-4002-bca2-5b6f0c778088 service nova] Creating event network-vif-plugged:b082c8ad-e4de-4a60-b4fe-8c92c80f4c32 for instance bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 on hv-cinder-84773 Jun 27 09:39:06.480962 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-57d67eb9-18db-4626-8dfd-d25a0b481d14 req-bc39258c-138e-4002-bca2-5b6f0c778088 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052399 Jun 27 09:39:06.484252 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 183/359] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:39:06.489182 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-b252d92d-7d1b-43d7-9d68-1825b188175b tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:06.490694 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-b252d92d-7d1b-43d7-9d68-1825b188175b tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:06.502001 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b252d92d-7d1b-43d7-9d68-1825b188175b tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:06.502699 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b252d92d-7d1b-43d7-9d68-1825b188175b tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:06.504469 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b252d92d-7d1b-43d7-9d68-1825b188175b tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:06.505097 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b252d92d-7d1b-43d7-9d68-1825b188175b tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:06.644198 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-1289a410-4f29-4f61-bb52-2bf777306313 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:06.654446 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-1289a410-4f29-4f61-bb52-2bf777306313 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1312 microversion: 2.1 time: 0.337487 Jun 27 09:39:06.663793 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 177/360] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:06 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1312 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:06.671025 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-5da11347-154a-4017-913b-795d097a4967 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:06.672205 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-5da11347-154a-4017-913b-795d097a4967 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:06.686899 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:06.691343 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5da11347-154a-4017-913b-795d097a4967 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:06.691980 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5da11347-154a-4017-913b-795d097a4967 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:06.692887 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5da11347-154a-4017-913b-795d097a4967 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:06.693872 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5da11347-154a-4017-913b-795d097a4967 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:06.739015 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-b252d92d-7d1b-43d7-9d68-1825b188175b tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:06.741386 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:06.752862 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-b252d92d-7d1b-43d7-9d68-1825b188175b tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1313 microversion: 2.1 time: 0.269425 Jun 27 09:39:06.753452 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 184/361] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:06 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:07.103213 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-5da11347-154a-4017-913b-795d097a4967 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:07.112757 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-5da11347-154a-4017-913b-795d097a4967 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:07.114338 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-5da11347-154a-4017-913b-795d097a4967 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:07.115898 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-5da11347-154a-4017-913b-795d097a4967 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.456033 Jun 27 09:39:07.116450 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 178/362] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:06 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:07.329976 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-d77105db-1b14-484e-aa7a-cc2611114e5f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:07.330942 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-d77105db-1b14-484e-aa7a-cc2611114e5f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:07.345478 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d77105db-1b14-484e-aa7a-cc2611114e5f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:07.349649 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d77105db-1b14-484e-aa7a-cc2611114e5f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:07.349649 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d77105db-1b14-484e-aa7a-cc2611114e5f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:07.349649 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d77105db-1b14-484e-aa7a-cc2611114e5f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:07.561716 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-d77105db-1b14-484e-aa7a-cc2611114e5f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:07.574018 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-d77105db-1b14-484e-aa7a-cc2611114e5f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1372 microversion: 2.1 time: 0.245131 Jun 27 09:39:07.579312 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 185/363] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:07 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1372 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:07.673354 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-218badda-ab3e-4058-890a-3bb34e2fd5bc tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:07.674056 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-218badda-ab3e-4058-890a-3bb34e2fd5bc tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:07.684862 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-218badda-ab3e-4058-890a-3bb34e2fd5bc tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:07.685520 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-218badda-ab3e-4058-890a-3bb34e2fd5bc tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:07.694593 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-218badda-ab3e-4058-890a-3bb34e2fd5bc tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:07.704233 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-218badda-ab3e-4058-890a-3bb34e2fd5bc tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:07.770461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-faa6607b-de59-40f6-a393-5c8a165cc30a tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:07.771356 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-faa6607b-de59-40f6-a393-5c8a165cc30a tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:07.783958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-faa6607b-de59-40f6-a393-5c8a165cc30a tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:07.784859 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-faa6607b-de59-40f6-a393-5c8a165cc30a tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:07.785857 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-faa6607b-de59-40f6-a393-5c8a165cc30a tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:07.786529 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-faa6607b-de59-40f6-a393-5c8a165cc30a tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:07.966072 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-faa6607b-de59-40f6-a393-5c8a165cc30a tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:07.981980 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-faa6607b-de59-40f6-a393-5c8a165cc30a tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1313 microversion: 2.1 time: 0.216010 Jun 27 09:39:07.996995 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 186/364] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:07 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:08.023266 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-218badda-ab3e-4058-890a-3bb34e2fd5bc tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:08.033877 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-218badda-ab3e-4058-890a-3bb34e2fd5bc tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1312 microversion: 2.1 time: 0.366192 Jun 27 09:39:08.036884 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 179/365] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:07 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1312 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:08.138664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-fb2cd884-6e74-4b4c-9e7e-7c0ea28a1fc7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:08.140603 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-fb2cd884-6e74-4b4c-9e7e-7c0ea28a1fc7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:08.156532 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fb2cd884-6e74-4b4c-9e7e-7c0ea28a1fc7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:08.156999 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fb2cd884-6e74-4b4c-9e7e-7c0ea28a1fc7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:08.160341 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fb2cd884-6e74-4b4c-9e7e-7c0ea28a1fc7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:08.160341 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fb2cd884-6e74-4b4c-9e7e-7c0ea28a1fc7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:08.424303 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-fb2cd884-6e74-4b4c-9e7e-7c0ea28a1fc7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:08.436800 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-fb2cd884-6e74-4b4c-9e7e-7c0ea28a1fc7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:08.438873 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-fb2cd884-6e74-4b4c-9e7e-7c0ea28a1fc7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:08.440291 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-fb2cd884-6e74-4b4c-9e7e-7c0ea28a1fc7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.308034 Jun 27 09:39:08.442636 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 187/366] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:08 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:08.599980 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-b387f8ea-f47a-4a10-8783-50d94ef9b894 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:08.600720 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-b387f8ea-f47a-4a10-8783-50d94ef9b894 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:08.630551 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b387f8ea-f47a-4a10-8783-50d94ef9b894 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:08.632861 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b387f8ea-f47a-4a10-8783-50d94ef9b894 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:08.633771 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b387f8ea-f47a-4a10-8783-50d94ef9b894 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:08.634221 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b387f8ea-f47a-4a10-8783-50d94ef9b894 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:08.973065 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-b387f8ea-f47a-4a10-8783-50d94ef9b894 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:08.983240 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-b387f8ea-f47a-4a10-8783-50d94ef9b894 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1372 microversion: 2.1 time: 0.396549 Jun 27 09:39:08.984612 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 180/367] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:08 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1372 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:08.998924 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f00b0c65-44d5-49dc-9a39-cb702a23cdf4 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:08.999888 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-f00b0c65-44d5-49dc-9a39-cb702a23cdf4 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:09.009905 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f00b0c65-44d5-49dc-9a39-cb702a23cdf4 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:09.010372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f00b0c65-44d5-49dc-9a39-cb702a23cdf4 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:09.011163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f00b0c65-44d5-49dc-9a39-cb702a23cdf4 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:09.011646 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f00b0c65-44d5-49dc-9a39-cb702a23cdf4 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:09.053458 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-8eef61a4-6965-44d0-96ad-a0745e21766e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:09.054966 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-8eef61a4-6965-44d0-96ad-a0745e21766e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:09.067470 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8eef61a4-6965-44d0-96ad-a0745e21766e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:09.069323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8eef61a4-6965-44d0-96ad-a0745e21766e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:09.070397 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8eef61a4-6965-44d0-96ad-a0745e21766e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:09.073195 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8eef61a4-6965-44d0-96ad-a0745e21766e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:09.204002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f00b0c65-44d5-49dc-9a39-cb702a23cdf4 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:09.215085 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-f00b0c65-44d5-49dc-9a39-cb702a23cdf4 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1313 microversion: 2.1 time: 0.220188 Jun 27 09:39:09.227010 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 188/368] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:08 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:09.242703 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8eef61a4-6965-44d0-96ad-a0745e21766e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:09.251377 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-8eef61a4-6965-44d0-96ad-a0745e21766e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1312 microversion: 2.1 time: 0.202528 Jun 27 09:39:09.252902 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 181/369] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:09 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1312 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:09.469636 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-2b57cdf3-a16a-45cc-8b8d-69e6c79e9f70 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:09.470916 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-2b57cdf3-a16a-45cc-8b8d-69e6c79e9f70 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:09.486222 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2b57cdf3-a16a-45cc-8b8d-69e6c79e9f70 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:09.486682 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2b57cdf3-a16a-45cc-8b8d-69e6c79e9f70 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:09.487481 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2b57cdf3-a16a-45cc-8b8d-69e6c79e9f70 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:09.495860 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2b57cdf3-a16a-45cc-8b8d-69e6c79e9f70 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:09.700250 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2b57cdf3-a16a-45cc-8b8d-69e6c79e9f70 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:09.711373 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2b57cdf3-a16a-45cc-8b8d-69e6c79e9f70 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:09.712920 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2b57cdf3-a16a-45cc-8b8d-69e6c79e9f70 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:09.714250 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-2b57cdf3-a16a-45cc-8b8d-69e6c79e9f70 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.256373 Jun 27 09:39:09.727732 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 189/370] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:09 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:09.814168 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-4b411847-73c4-4241-86a0-ab5bc76ff6d0 req-077c840b-b5aa-430c-94ca-0737ac09def0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45393090-60ab-4485-af6c-8e4f8fbbfef4", "name": "network-vif-plugged", "status": "completed", "tag": "1efbdb28-4c1d-4e61-be86-3eade588e95d"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:09.814168 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-4b411847-73c4-4241-86a0-ab5bc76ff6d0 req-077c840b-b5aa-430c-94ca-0737ac09def0 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:09.814168 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-4b411847-73c4-4241-86a0-ab5bc76ff6d0 req-077c840b-b5aa-430c-94ca-0737ac09def0 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:09.814168 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-4b411847-73c4-4241-86a0-ab5bc76ff6d0 req-077c840b-b5aa-430c-94ca-0737ac09def0 service nova] Creating event network-vif-plugged:1efbdb28-4c1d-4e61-be86-3eade588e95d for instance 45393090-60ab-4485-af6c-8e4f8fbbfef4 on hv-cinder-84773 Jun 27 09:39:09.815146 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-4b411847-73c4-4241-86a0-ab5bc76ff6d0 req-077c840b-b5aa-430c-94ca-0737ac09def0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029842 Jun 27 09:39:09.815146 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 182/371] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:39:10.001030 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-134d66e6-f968-4720-9a1c-0c8fce61169a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:10.001845 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-134d66e6-f968-4720-9a1c-0c8fce61169a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:10.007834 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-134d66e6-f968-4720-9a1c-0c8fce61169a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:10.008277 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-134d66e6-f968-4720-9a1c-0c8fce61169a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:10.009067 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-134d66e6-f968-4720-9a1c-0c8fce61169a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:10.009496 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-134d66e6-f968-4720-9a1c-0c8fce61169a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:10.149195 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-134d66e6-f968-4720-9a1c-0c8fce61169a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:10.163254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-134d66e6-f968-4720-9a1c-0c8fce61169a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1566 microversion: 2.1 time: 0.161549 Jun 27 09:39:10.163254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 190/372] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:09 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:10.181648 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-1e084c89-396e-41f4-8bed-3e6031c43690 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:10.182265 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-1e084c89-396e-41f4-8bed-3e6031c43690 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:10.191112 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1e084c89-396e-41f4-8bed-3e6031c43690 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:10.191587 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1e084c89-396e-41f4-8bed-3e6031c43690 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:10.192361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1e084c89-396e-41f4-8bed-3e6031c43690 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:10.192791 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1e084c89-396e-41f4-8bed-3e6031c43690 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:10.232982 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-76f153e0-234f-463f-843e-64be70347b82 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:10.233606 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-76f153e0-234f-463f-843e-64be70347b82 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:10.255204 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-76f153e0-234f-463f-843e-64be70347b82 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:10.255629 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-76f153e0-234f-463f-843e-64be70347b82 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:10.256428 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-76f153e0-234f-463f-843e-64be70347b82 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:10.256865 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-76f153e0-234f-463f-843e-64be70347b82 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:10.449292 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-1e084c89-396e-41f4-8bed-3e6031c43690 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.274854 Jun 27 09:39:10.457165 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 183/373] 10.222.0.64 () {58 vars in 1274 bytes} [Mon Jun 27 09:39:10 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3/os-interface => generated 284 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:39:10.464458 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-3291df32-69b5-459e-8ad0-961aa732f78c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:10.467659 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-3291df32-69b5-459e-8ad0-961aa732f78c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:10.479478 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3291df32-69b5-459e-8ad0-961aa732f78c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:10.480323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3291df32-69b5-459e-8ad0-961aa732f78c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:10.481264 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3291df32-69b5-459e-8ad0-961aa732f78c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:10.481871 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3291df32-69b5-459e-8ad0-961aa732f78c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:10.583964 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-76f153e0-234f-463f-843e-64be70347b82 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:10.596070 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-76f153e0-234f-463f-843e-64be70347b82 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1313 microversion: 2.1 time: 0.367305 Jun 27 09:39:10.609203 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 191/374] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:10 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:10.735194 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-4a0e41a8-219c-414f-a4a7-ff046f15348d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:10.736208 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-4a0e41a8-219c-414f-a4a7-ff046f15348d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:10.749644 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4a0e41a8-219c-414f-a4a7-ff046f15348d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:10.750114 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4a0e41a8-219c-414f-a4a7-ff046f15348d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:10.757946 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4a0e41a8-219c-414f-a4a7-ff046f15348d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:10.757946 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4a0e41a8-219c-414f-a4a7-ff046f15348d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:10.809618 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-3291df32-69b5-459e-8ad0-961aa732f78c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:10.828821 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-3291df32-69b5-459e-8ad0-961aa732f78c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1312 microversion: 2.1 time: 0.362427 Jun 27 09:39:10.829467 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 184/375] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:10 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1312 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:11.037588 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4a0e41a8-219c-414f-a4a7-ff046f15348d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:11.047789 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4a0e41a8-219c-414f-a4a7-ff046f15348d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:11.049597 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4a0e41a8-219c-414f-a4a7-ff046f15348d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:11.050867 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-4a0e41a8-219c-414f-a4a7-ff046f15348d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.320605 Jun 27 09:39:11.051883 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 192/376] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:10 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:11.620209 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-56e90984-904a-4929-b3cf-3bdb5cba49db tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:11.628487 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-56e90984-904a-4929-b3cf-3bdb5cba49db tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:11.678205 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-56e90984-904a-4929-b3cf-3bdb5cba49db tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:11.683661 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-56e90984-904a-4929-b3cf-3bdb5cba49db tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:11.687905 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-56e90984-904a-4929-b3cf-3bdb5cba49db tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:11.702523 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-56e90984-904a-4929-b3cf-3bdb5cba49db tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:11.746277 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=100 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:11.846630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-ecb6fd27-0a75-44fc-84a8-f00ce0f386d7 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:11.847799 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-ecb6fd27-0a75-44fc-84a8-f00ce0f386d7 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:11.863591 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ecb6fd27-0a75-44fc-84a8-f00ce0f386d7 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:11.864339 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ecb6fd27-0a75-44fc-84a8-f00ce0f386d7 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:11.865342 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ecb6fd27-0a75-44fc-84a8-f00ce0f386d7 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:11.865958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ecb6fd27-0a75-44fc-84a8-f00ce0f386d7 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:12.267396 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-ecb6fd27-0a75-44fc-84a8-f00ce0f386d7 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:12.297227 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-ecb6fd27-0a75-44fc-84a8-f00ce0f386d7 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1312 microversion: 2.1 time: 0.454400 Jun 27 09:39:12.303072 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 193/377] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:11 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1312 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:12.315781 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-6bfdfcb4-1368-4852-95c3-719be47f079b req-d2909ef6-17d9-4a24-b2d3-cc6e4687b098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "150e9347-3eae-4d8c-8b7e-24ac9f867f1f", "name": "network-vif-plugged", "status": "completed", "tag": "d213adbe-5b3f-4aea-a20c-fc98a6690d24"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:12.328183 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-6bfdfcb4-1368-4852-95c3-719be47f079b req-d2909ef6-17d9-4a24-b2d3-cc6e4687b098 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:12.333686 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-6bfdfcb4-1368-4852-95c3-719be47f079b req-d2909ef6-17d9-4a24-b2d3-cc6e4687b098 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:12.342697 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-6bfdfcb4-1368-4852-95c3-719be47f079b req-d2909ef6-17d9-4a24-b2d3-cc6e4687b098 service nova] Creating event network-vif-plugged:d213adbe-5b3f-4aea-a20c-fc98a6690d24 for instance 150e9347-3eae-4d8c-8b7e-24ac9f867f1f on hv-cinder-84773 Jun 27 09:39:12.349214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-6bfdfcb4-1368-4852-95c3-719be47f079b req-d2909ef6-17d9-4a24-b2d3-cc6e4687b098 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043333 Jun 27 09:39:12.350751 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 194/378] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:39:12.357837 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-2d92a395-0bda-4f54-8be0-9945ab9ca88c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:12.358723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-2d92a395-0bda-4f54-8be0-9945ab9ca88c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:12.367737 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2d92a395-0bda-4f54-8be0-9945ab9ca88c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:12.368941 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2d92a395-0bda-4f54-8be0-9945ab9ca88c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:12.369981 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2d92a395-0bda-4f54-8be0-9945ab9ca88c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:12.371357 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2d92a395-0bda-4f54-8be0-9945ab9ca88c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:12.679264 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-56e90984-904a-4929-b3cf-3bdb5cba49db tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:12.691295 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-56e90984-904a-4929-b3cf-3bdb5cba49db tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1313 microversion: 2.1 time: 1.078774 Jun 27 09:39:12.692251 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 185/379] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:11 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1313 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:12.716569 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2d92a395-0bda-4f54-8be0-9945ab9ca88c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:12.734786 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2d92a395-0bda-4f54-8be0-9945ab9ca88c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:12.736324 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2d92a395-0bda-4f54-8be0-9945ab9ca88c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:12.737512 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-2d92a395-0bda-4f54-8be0-9945ab9ca88c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.385336 Jun 27 09:39:12.743262 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 195/380] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:12 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:12.793266 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-e047d714-321c-408a-8b67-a445b69c62dc req-ea61e422-6acf-4b43-9f0c-b79bba456eec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3", "tag": "b082c8ad-e4de-4a60-b4fe-8c92c80f4c32"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:12.808140 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-e047d714-321c-408a-8b67-a445b69c62dc req-ea61e422-6acf-4b43-9f0c-b79bba456eec service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:12.809286 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-e047d714-321c-408a-8b67-a445b69c62dc req-ea61e422-6acf-4b43-9f0c-b79bba456eec service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:12.841312 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-e047d714-321c-408a-8b67-a445b69c62dc req-ea61e422-6acf-4b43-9f0c-b79bba456eec service nova] Creating event network-changed:b082c8ad-e4de-4a60-b4fe-8c92c80f4c32 for instance bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 on hv-cinder-84773 Jun 27 09:39:12.860044 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-e047d714-321c-408a-8b67-a445b69c62dc req-ea61e422-6acf-4b43-9f0c-b79bba456eec service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073145 Jun 27 09:39:12.860888 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 186/381] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:39:13.325577 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-1b681fe8-888f-48b7-bbb7-6a2bd562c892 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:13.326815 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-1b681fe8-888f-48b7-bbb7-6a2bd562c892 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:13.349980 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1b681fe8-888f-48b7-bbb7-6a2bd562c892 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:13.349980 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1b681fe8-888f-48b7-bbb7-6a2bd562c892 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:13.350651 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1b681fe8-888f-48b7-bbb7-6a2bd562c892 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:13.351096 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1b681fe8-888f-48b7-bbb7-6a2bd562c892 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:13.710296 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-fa0ba791-ed7a-4a8a-925f-8bfae4cf1da2 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:13.711653 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-fa0ba791-ed7a-4a8a-925f-8bfae4cf1da2 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:13.725183 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fa0ba791-ed7a-4a8a-925f-8bfae4cf1da2 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:13.731149 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fa0ba791-ed7a-4a8a-925f-8bfae4cf1da2 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:13.732227 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fa0ba791-ed7a-4a8a-925f-8bfae4cf1da2 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:13.734225 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fa0ba791-ed7a-4a8a-925f-8bfae4cf1da2 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:13.782335 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-1b681fe8-888f-48b7-bbb7-6a2bd562c892 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:13.797519 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-1b681fe8-888f-48b7-bbb7-6a2bd562c892 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1312 microversion: 2.1 time: 0.475261 Jun 27 09:39:13.798484 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 196/382] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:13 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1312 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:13.827553 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-ec5b5f00-348c-4bc0-90e1-869b0ef7387f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:13.829272 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-ec5b5f00-348c-4bc0-90e1-869b0ef7387f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:13.832521 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:13.841401 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ec5b5f00-348c-4bc0-90e1-869b0ef7387f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:13.842319 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ec5b5f00-348c-4bc0-90e1-869b0ef7387f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:13.843792 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ec5b5f00-348c-4bc0-90e1-869b0ef7387f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:13.844570 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ec5b5f00-348c-4bc0-90e1-869b0ef7387f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:14.120425 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-ec5b5f00-348c-4bc0-90e1-869b0ef7387f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:14.120425 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-ec5b5f00-348c-4bc0-90e1-869b0ef7387f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:14.120732 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-ec5b5f00-348c-4bc0-90e1-869b0ef7387f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:14.120732 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-ec5b5f00-348c-4bc0-90e1-869b0ef7387f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.287457 Jun 27 09:39:14.120732 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 197/383] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:13 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:14.825139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-861e19d2-d0f2-4cc1-a648-e75986b69b9e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:14.825892 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-861e19d2-d0f2-4cc1-a648-e75986b69b9e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:14.834783 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-861e19d2-d0f2-4cc1-a648-e75986b69b9e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:14.835809 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-861e19d2-d0f2-4cc1-a648-e75986b69b9e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:14.837947 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-861e19d2-d0f2-4cc1-a648-e75986b69b9e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:14.839581 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-861e19d2-d0f2-4cc1-a648-e75986b69b9e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:14.900630 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-fa0ba791-ed7a-4a8a-925f-8bfae4cf1da2 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:14.908370 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-fa0ba791-ed7a-4a8a-925f-8bfae4cf1da2 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1463 microversion: 2.1 time: 1.203521 Jun 27 09:39:14.908941 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 187/384] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:13 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1463 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:14.966713 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-dc9b5fd4-952f-4e7e-8327-f29bbd5ddbb4 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:14.967415 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-dc9b5fd4-952f-4e7e-8327-f29bbd5ddbb4 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:14.975890 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dc9b5fd4-952f-4e7e-8327-f29bbd5ddbb4 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:14.977889 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dc9b5fd4-952f-4e7e-8327-f29bbd5ddbb4 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:14.978938 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dc9b5fd4-952f-4e7e-8327-f29bbd5ddbb4 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:14.979706 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dc9b5fd4-952f-4e7e-8327-f29bbd5ddbb4 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:15.008931 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-dc9b5fd4-952f-4e7e-8327-f29bbd5ddbb4 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Going to try to terminate instance {{(pid=124870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 09:39:15.053350 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-861e19d2-d0f2-4cc1-a648-e75986b69b9e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:15.064775 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-861e19d2-d0f2-4cc1-a648-e75986b69b9e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1312 microversion: 2.1 time: 0.246113 Jun 27 09:39:15.067986 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 198/385] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:14 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1312 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:15.126998 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-5562bf6b-9b6f-41cf-8953-d2a4079cd47d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:15.127973 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-5562bf6b-9b6f-41cf-8953-d2a4079cd47d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:15.150023 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5562bf6b-9b6f-41cf-8953-d2a4079cd47d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:15.158350 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5562bf6b-9b6f-41cf-8953-d2a4079cd47d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:15.165893 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5562bf6b-9b6f-41cf-8953-d2a4079cd47d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:15.168788 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5562bf6b-9b6f-41cf-8953-d2a4079cd47d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:15.418458 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-dc9b5fd4-952f-4e7e-8327-f29bbd5ddbb4 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "DELETE /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 204 len: 0 microversion: 2.1 time: 0.455670 Jun 27 09:39:15.419623 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 188/386] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:39:14 2022] DELETE /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 09:39:15.428197 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-0702fce2-5762-4e6a-9e57-12373f6e93cf tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:15.428889 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-0702fce2-5762-4e6a-9e57-12373f6e93cf tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:15.448669 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0702fce2-5762-4e6a-9e57-12373f6e93cf tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:15.449117 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0702fce2-5762-4e6a-9e57-12373f6e93cf tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:15.449916 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0702fce2-5762-4e6a-9e57-12373f6e93cf tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:15.462264 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0702fce2-5762-4e6a-9e57-12373f6e93cf tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:15.533231 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-5562bf6b-9b6f-41cf-8953-d2a4079cd47d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:15.566558 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-5562bf6b-9b6f-41cf-8953-d2a4079cd47d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:15.569774 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-5562bf6b-9b6f-41cf-8953-d2a4079cd47d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:15.572827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-5562bf6b-9b6f-41cf-8953-d2a4079cd47d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.451757 Jun 27 09:39:15.574391 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 199/387] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:15 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:15.896403 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-0702fce2-5762-4e6a-9e57-12373f6e93cf tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:15.909895 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-0702fce2-5762-4e6a-9e57-12373f6e93cf tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1469 microversion: 2.1 time: 0.485736 Jun 27 09:39:15.922377 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 189/388] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:15 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1469 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:16.085596 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-85ed74ee-03fd-4ebb-9d78-28078e3a8984 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:16.086958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-85ed74ee-03fd-4ebb-9d78-28078e3a8984 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:16.101886 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-85ed74ee-03fd-4ebb-9d78-28078e3a8984 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:16.106024 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-85ed74ee-03fd-4ebb-9d78-28078e3a8984 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:16.107154 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-85ed74ee-03fd-4ebb-9d78-28078e3a8984 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:16.109256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-85ed74ee-03fd-4ebb-9d78-28078e3a8984 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:16.402424 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-85ed74ee-03fd-4ebb-9d78-28078e3a8984 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:16.411860 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-85ed74ee-03fd-4ebb-9d78-28078e3a8984 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1312 microversion: 2.1 time: 0.331208 Jun 27 09:39:16.412428 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 200/389] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:16 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1312 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:16.456849 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-2d43008d-bf36-4cbf-9a88-5b0c92953395 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Action: 'create', calling method: .version_select at 0x7ffa9d9985e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-442421444", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDo+pM6W5MvziSZmX9851ptJ1MghNe40EcO4q201MsrGJfJDx5lg1NQXkOwGEkYBUvlC9raVawBzQZ8gfX/OnsQV3WZ8ovtP+KzMT2aX4gL4AyWNOFQp1wHU/tRb0d72Tw=="}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:16.496196 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-2d43008d-bf36-4cbf-9a88-5b0c92953395 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Getting quotas for project 55f89ed92a124e2c8a274975bc0935ba. Resources: {'key_pairs'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:39:16.507814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-2d43008d-bf36-4cbf-9a88-5b0c92953395 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Getting quotas for user 5778103c646049f5944934e775cba9da and project 55f89ed92a124e2c8a274975bc0935ba. Resources: {'key_pairs'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:39:16.591858 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-9ad71552-fb75-41ac-85ff-a5282385ebba tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:16.592482 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-9ad71552-fb75-41ac-85ff-a5282385ebba tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:16.601054 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9ad71552-fb75-41ac-85ff-a5282385ebba tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:16.602919 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9ad71552-fb75-41ac-85ff-a5282385ebba tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:16.604193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9ad71552-fb75-41ac-85ff-a5282385ebba tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:16.607275 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9ad71552-fb75-41ac-85ff-a5282385ebba tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:16.657954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-2d43008d-bf36-4cbf-9a88-5b0c92953395 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.206109 Jun 27 09:39:16.667683 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 190/390] 10.222.0.64 () {60 vars in 1158 bytes} [Mon Jun 27 09:39:16 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:39:16.822751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-90954064-e945-4d1c-8850-c96be1265b13 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-176552933", "imageRef": "35407665-85e2-4cca-91bf-758c1a0cb822", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-442421444", "networks": [{"uuid": "0f8b5888-2ff0-4666-83fc-263d4a6a238e"}]}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:16.909130 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-9ad71552-fb75-41ac-85ff-a5282385ebba tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:16.922032 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-9ad71552-fb75-41ac-85ff-a5282385ebba tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:16.928172 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.network.neutron [None req-90954064-e945-4d1c-8850-c96be1265b13 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] validate_networks() for [('0f8b5888-2ff0-4666-83fc-263d4a6a238e', None, None, None, None, None)] {{(pid=124870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 09:39:16.929487 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-9ad71552-fb75-41ac-85ff-a5282385ebba tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:16.932540 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-9ad71552-fb75-41ac-85ff-a5282385ebba tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.344564 Jun 27 09:39:16.940274 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 201/391] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:16 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:39:16.945418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-4eae395a-549c-4642-8917-ff5ae5600dcd tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:16.946054 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-4eae395a-549c-4642-8917-ff5ae5600dcd tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:16.952531 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4eae395a-549c-4642-8917-ff5ae5600dcd tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:16.952911 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4eae395a-549c-4642-8917-ff5ae5600dcd tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:16.953679 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4eae395a-549c-4642-8917-ff5ae5600dcd tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:16.954111 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4eae395a-549c-4642-8917-ff5ae5600dcd tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:16.958604 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=100 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:17.176996 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4eae395a-549c-4642-8917-ff5ae5600dcd tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:17.185970 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-4eae395a-549c-4642-8917-ff5ae5600dcd tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1469 microversion: 2.1 time: 0.244499 Jun 27 09:39:17.187380 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 202/392] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:16 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1469 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:17.429830 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-235728ef-4058-46f7-aec1-5ecc05767dad tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:17.430506 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-235728ef-4058-46f7-aec1-5ecc05767dad tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:17.440016 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-235728ef-4058-46f7-aec1-5ecc05767dad tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:17.440468 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-235728ef-4058-46f7-aec1-5ecc05767dad tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:17.441267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-235728ef-4058-46f7-aec1-5ecc05767dad tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:17.441702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-235728ef-4058-46f7-aec1-5ecc05767dad tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:17.652050 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-235728ef-4058-46f7-aec1-5ecc05767dad tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:17.661723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-235728ef-4058-46f7-aec1-5ecc05767dad tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1312 microversion: 2.1 time: 0.235665 Jun 27 09:39:17.673828 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 203/393] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:17 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1312 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:17.933003 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-90954064-e945-4d1c-8850-c96be1265b13 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Flavor limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 09:39:17.936313 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-90954064-e945-4d1c-8850-c96be1265b13 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Image limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 09:39:17.937141 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-90954064-e945-4d1c-8850-c96be1265b13 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Flavor pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 09:39:17.937882 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-90954064-e945-4d1c-8850-c96be1265b13 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Image pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 09:39:17.938721 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-90954064-e945-4d1c-8850-c96be1265b13 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 09:39:17.951658 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-fc4c4ea7-c0bf-4346-b96f-ca60f55c0f63 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:17.952701 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-fc4c4ea7-c0bf-4346-b96f-ca60f55c0f63 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:17.972656 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fc4c4ea7-c0bf-4346-b96f-ca60f55c0f63 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:17.977692 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fc4c4ea7-c0bf-4346-b96f-ca60f55c0f63 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:17.979491 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-90954064-e945-4d1c-8850-c96be1265b13 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:17.981182 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fc4c4ea7-c0bf-4346-b96f-ca60f55c0f63 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:17.981881 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-90954064-e945-4d1c-8850-c96be1265b13 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:17.982622 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fc4c4ea7-c0bf-4346-b96f-ca60f55c0f63 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:17.983710 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-90954064-e945-4d1c-8850-c96be1265b13 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:17.992236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-90954064-e945-4d1c-8850-c96be1265b13 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:18.056449 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-90954064-e945-4d1c-8850-c96be1265b13 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Getting quotas for project 55f89ed92a124e2c8a274975bc0935ba. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:39:18.064749 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-90954064-e945-4d1c-8850-c96be1265b13 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Getting quotas for user 5778103c646049f5944934e775cba9da and project 55f89ed92a124e2c8a274975bc0935ba. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:39:18.126000 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-90954064-e945-4d1c-8850-c96be1265b13 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Going to run 1 instances... {{(pid=124870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 09:39:18.134515 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-90954064-e945-4d1c-8850-c96be1265b13 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35407665-85e2-4cca-91bf-758c1a0cb822',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 09:39:18.308779 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-90954064-e945-4d1c-8850-c96be1265b13 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.492073 Jun 27 09:39:18.311336 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 191/394] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 27 09:39:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 09:39:18.321400 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-2c74d9fd-57af-4335-b378-583730fb5f59 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:18.324619 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-2c74d9fd-57af-4335-b378-583730fb5f59 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:18.367179 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2c74d9fd-57af-4335-b378-583730fb5f59 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:18.367179 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2c74d9fd-57af-4335-b378-583730fb5f59 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:18.367179 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2c74d9fd-57af-4335-b378-583730fb5f59 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:18.367179 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2c74d9fd-57af-4335-b378-583730fb5f59 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:18.368747 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-fc4c4ea7-c0bf-4346-b96f-ca60f55c0f63 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:18.376458 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-fc4c4ea7-c0bf-4346-b96f-ca60f55c0f63 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:18.378759 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-fc4c4ea7-c0bf-4346-b96f-ca60f55c0f63 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:18.492289 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-fc4c4ea7-c0bf-4346-b96f-ca60f55c0f63 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.434261 Jun 27 09:39:18.492289 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 204/395] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:17 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:39:18.492289 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-9df167b7-2e0d-4244-9487-b60a92a64872 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:18.492289 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-9df167b7-2e0d-4244-9487-b60a92a64872 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:18.494623 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-9df167b7-2e0d-4244-9487-b60a92a64872 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:18.494623 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-9df167b7-2e0d-4244-9487-b60a92a64872 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1257 microversion: 2.1 time: 0.102304 Jun 27 09:39:18.494623 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 205/396] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:18 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1257 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:18.607837 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-2c74d9fd-57af-4335-b378-583730fb5f59 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:18.607837 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-2c74d9fd-57af-4335-b378-583730fb5f59 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1469 microversion: 2.1 time: 0.251158 Jun 27 09:39:18.607837 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 192/397] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:18 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1469 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:18.680508 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f6c0d433-80e1-45b9-b123-080c6552b2db tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:18.681150 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-f6c0d433-80e1-45b9-b123-080c6552b2db tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:18.687201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f6c0d433-80e1-45b9-b123-080c6552b2db tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:18.687696 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f6c0d433-80e1-45b9-b123-080c6552b2db tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:18.688479 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f6c0d433-80e1-45b9-b123-080c6552b2db tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:18.698497 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f6c0d433-80e1-45b9-b123-080c6552b2db tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:18.853443 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f6c0d433-80e1-45b9-b123-080c6552b2db tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:18.864672 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-f6c0d433-80e1-45b9-b123-080c6552b2db tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1312 microversion: 2.1 time: 0.186634 Jun 27 09:39:18.871482 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 206/398] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:18 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1312 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:19.400614 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c7060887-d89b-4287-85c2-09d59bc0a08f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:19.401477 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-c7060887-d89b-4287-85c2-09d59bc0a08f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:19.411483 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c7060887-d89b-4287-85c2-09d59bc0a08f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:19.412054 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c7060887-d89b-4287-85c2-09d59bc0a08f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:19.412955 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c7060887-d89b-4287-85c2-09d59bc0a08f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:19.413603 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c7060887-d89b-4287-85c2-09d59bc0a08f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:19.514772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-959fd3e1-c66f-4969-adc1-c582e8cd7d46 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:19.516674 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-959fd3e1-c66f-4969-adc1-c582e8cd7d46 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:19.625887 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-959fd3e1-c66f-4969-adc1-c582e8cd7d46 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:19.633063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-959fd3e1-c66f-4969-adc1-c582e8cd7d46 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1257 microversion: 2.1 time: 0.123879 Jun 27 09:39:19.636173 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 207/399] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:19 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1257 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:19.658593 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-fbe77ffb-5f58-4472-bfa0-35f9e837c4ad tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:19.658593 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-fbe77ffb-5f58-4472-bfa0-35f9e837c4ad tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:19.671065 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fbe77ffb-5f58-4472-bfa0-35f9e837c4ad tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:19.673478 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fbe77ffb-5f58-4472-bfa0-35f9e837c4ad tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:19.681718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fbe77ffb-5f58-4472-bfa0-35f9e837c4ad tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:19.684275 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fbe77ffb-5f58-4472-bfa0-35f9e837c4ad tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:19.742925 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-c7060887-d89b-4287-85c2-09d59bc0a08f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:19.756474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-c7060887-d89b-4287-85c2-09d59bc0a08f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:19.758668 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-c7060887-d89b-4287-85c2-09d59bc0a08f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:19.759938 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-c7060887-d89b-4287-85c2-09d59bc0a08f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.364032 Jun 27 09:39:19.760810 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 193/400] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:19 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:19.883587 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-904b8318-d7cf-4c50-986f-d80a31f644bd tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:19.884463 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-904b8318-d7cf-4c50-986f-d80a31f644bd tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:19.894779 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-904b8318-d7cf-4c50-986f-d80a31f644bd tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:19.898002 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-904b8318-d7cf-4c50-986f-d80a31f644bd tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:19.902818 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-904b8318-d7cf-4c50-986f-d80a31f644bd tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:19.903978 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-904b8318-d7cf-4c50-986f-d80a31f644bd tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:19.937606 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-fbe77ffb-5f58-4472-bfa0-35f9e837c4ad tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:19.952273 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-fbe77ffb-5f58-4472-bfa0-35f9e837c4ad tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1469 microversion: 2.1 time: 0.311284 Jun 27 09:39:19.952758 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 208/401] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:19 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1469 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:20.295323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-904b8318-d7cf-4c50-986f-d80a31f644bd tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:20.305738 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-904b8318-d7cf-4c50-986f-d80a31f644bd tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1496 microversion: 2.1 time: 0.425474 Jun 27 09:39:20.306595 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 194/402] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:19 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1496 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:20.657931 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-b57dd88e-08e8-45f0-83ad-7682ead7158a tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:20.658643 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-b57dd88e-08e8-45f0-83ad-7682ead7158a tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:20.666629 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b57dd88e-08e8-45f0-83ad-7682ead7158a tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:20.668241 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b57dd88e-08e8-45f0-83ad-7682ead7158a tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:20.668241 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b57dd88e-08e8-45f0-83ad-7682ead7158a tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:20.668444 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b57dd88e-08e8-45f0-83ad-7682ead7158a tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:20.779902 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c7f9d5fa-b04e-48eb-a6f3-a147c3737153 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:20.780946 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-b57dd88e-08e8-45f0-83ad-7682ead7158a tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:20.781391 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-c7f9d5fa-b04e-48eb-a6f3-a147c3737153 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:20.792488 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-b57dd88e-08e8-45f0-83ad-7682ead7158a tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1261 microversion: 2.1 time: 0.138371 Jun 27 09:39:20.794448 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c7f9d5fa-b04e-48eb-a6f3-a147c3737153 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:20.794701 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 209/403] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:20 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1261 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:20.799084 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c7f9d5fa-b04e-48eb-a6f3-a147c3737153 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:20.800432 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c7f9d5fa-b04e-48eb-a6f3-a147c3737153 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:20.801107 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c7f9d5fa-b04e-48eb-a6f3-a147c3737153 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:20.970798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-48fc3e6c-658d-4ef7-af76-70bdc87225df tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:20.972173 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-48fc3e6c-658d-4ef7-af76-70bdc87225df tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:20.981012 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-48fc3e6c-658d-4ef7-af76-70bdc87225df tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:20.985652 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-48fc3e6c-658d-4ef7-af76-70bdc87225df tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:20.988007 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-48fc3e6c-658d-4ef7-af76-70bdc87225df tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:20.989541 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-48fc3e6c-658d-4ef7-af76-70bdc87225df tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:21.192750 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-48fc3e6c-658d-4ef7-af76-70bdc87225df tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:21.202506 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-c7f9d5fa-b04e-48eb-a6f3-a147c3737153 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:21.204835 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-48fc3e6c-658d-4ef7-af76-70bdc87225df tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1469 microversion: 2.1 time: 0.235856 Jun 27 09:39:21.205687 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 210/404] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:20 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1469 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:21.228379 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-c7f9d5fa-b04e-48eb-a6f3-a147c3737153 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:21.228738 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-bd1ab094-a842-427d-b6fb-be5562f73727 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Action: 'create', calling method: .version_select at 0x7ffa97630b80>, body: {"keypair": {"name": "tempest-keypair-2143385650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKpdfydKGM/fqU4s320WP/zm6F8LHzpHfVH8HfvJD3ZQEtpxAXW0Zmj9taaZuBt1+Km7pxOaEnCecoeL+Nx4BLz1nWlg85seyymdshnTJUE7hSn8faiehVKebQUCrW82A=="}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:21.229925 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-c7f9d5fa-b04e-48eb-a6f3-a147c3737153 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:21.231272 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-c7f9d5fa-b04e-48eb-a6f3-a147c3737153 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.455369 Jun 27 09:39:21.244254 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 195/405] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:20 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:21.249891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-24bccd6d-cd9e-4819-a4da-daf62389e014 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:21.255361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-24bccd6d-cd9e-4819-a4da-daf62389e014 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:21.257659 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-24bccd6d-cd9e-4819-a4da-daf62389e014 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:21.258950 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-24bccd6d-cd9e-4819-a4da-daf62389e014 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:21.259883 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-24bccd6d-cd9e-4819-a4da-daf62389e014 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:21.260588 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-24bccd6d-cd9e-4819-a4da-daf62389e014 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:21.280545 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-bd1ab094-a842-427d-b6fb-be5562f73727 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Getting quotas for project 4b698ead017b4ef8b397ee127b487309. Resources: {'key_pairs'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:39:21.293578 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-bd1ab094-a842-427d-b6fb-be5562f73727 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Getting quotas for user cc8a087e97424d2890952be33695378f and project 4b698ead017b4ef8b397ee127b487309. Resources: {'key_pairs'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:39:21.297198 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-24bccd6d-cd9e-4819-a4da-daf62389e014 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Going to try to terminate instance {{(pid=124870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 09:39:21.441351 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-bd1ab094-a842-427d-b6fb-be5562f73727 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.218434 Jun 27 09:39:21.447770 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 211/406] 10.222.0.64 () {60 vars in 1158 bytes} [Mon Jun 27 09:39:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:39:21.787309 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-24bccd6d-cd9e-4819-a4da-daf62389e014 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "DELETE /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 204 len: 0 microversion: 2.1 time: 0.541212 Jun 27 09:39:21.804438 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 196/407] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:39:21 2022] DELETE /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 09:39:21.810061 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-b23d5f2f-fdea-48c9-9802-9ff6337528ce tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:21.810876 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-b23d5f2f-fdea-48c9-9802-9ff6337528ce tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:21.812849 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-513da80c-cda7-4ffd-b5a2-ea7e952fc5d4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:21.813946 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-513da80c-cda7-4ffd-b5a2-ea7e952fc5d4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:21.818675 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b23d5f2f-fdea-48c9-9802-9ff6337528ce tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:21.819129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b23d5f2f-fdea-48c9-9802-9ff6337528ce tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:21.820463 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b23d5f2f-fdea-48c9-9802-9ff6337528ce tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:21.820463 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b23d5f2f-fdea-48c9-9802-9ff6337528ce tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:21.823473 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-513da80c-cda7-4ffd-b5a2-ea7e952fc5d4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:21.824206 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-513da80c-cda7-4ffd-b5a2-ea7e952fc5d4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:21.825179 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-513da80c-cda7-4ffd-b5a2-ea7e952fc5d4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:21.825802 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-513da80c-cda7-4ffd-b5a2-ea7e952fc5d4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:21.933929 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-513da80c-cda7-4ffd-b5a2-ea7e952fc5d4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:21.953381 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-513da80c-cda7-4ffd-b5a2-ea7e952fc5d4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1253 microversion: 2.1 time: 0.146555 Jun 27 09:39:21.954525 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 197/408] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:21 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1253 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:22.106216 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-b23d5f2f-fdea-48c9-9802-9ff6337528ce tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:22.117508 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-b23d5f2f-fdea-48c9-9802-9ff6337528ce tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1502 microversion: 2.1 time: 0.309400 Jun 27 09:39:22.117508 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 212/409] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:21 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1502 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:22.221402 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-cf862351-4f49-43a5-a06b-cf65d2a8f84b tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:22.222748 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-cf862351-4f49-43a5-a06b-cf65d2a8f84b tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:22.230444 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cf862351-4f49-43a5-a06b-cf65d2a8f84b tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:22.232166 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cf862351-4f49-43a5-a06b-cf65d2a8f84b tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:22.233176 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cf862351-4f49-43a5-a06b-cf65d2a8f84b tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:22.233934 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cf862351-4f49-43a5-a06b-cf65d2a8f84b tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:22.251325 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-6fe47a0c-3867-4118-b06d-1c6467848e84 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:22.253185 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-6fe47a0c-3867-4118-b06d-1c6467848e84 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:22.268612 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6fe47a0c-3867-4118-b06d-1c6467848e84 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:22.269431 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6fe47a0c-3867-4118-b06d-1c6467848e84 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:22.271563 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6fe47a0c-3867-4118-b06d-1c6467848e84 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:22.272510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6fe47a0c-3867-4118-b06d-1c6467848e84 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:22.460868 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6fe47a0c-3867-4118-b06d-1c6467848e84 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:22.473339 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6fe47a0c-3867-4118-b06d-1c6467848e84 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:22.474871 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6fe47a0c-3867-4118-b06d-1c6467848e84 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:22.476067 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-6fe47a0c-3867-4118-b06d-1c6467848e84 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.229055 Jun 27 09:39:22.477198 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 213/410] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:22 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:22.512278 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-cf862351-4f49-43a5-a06b-cf65d2a8f84b tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:22.525005 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-cf862351-4f49-43a5-a06b-cf65d2a8f84b tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1469 microversion: 2.1 time: 0.307825 Jun 27 09:39:22.525619 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 198/411] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:22 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1469 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:22.671350 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-70db6254-7b23-4ec6-9ce2-f11069a4aeab req-028c5a6e-eb2d-49c3-965f-bea0d45ffc7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45393090-60ab-4485-af6c-8e4f8fbbfef4", "name": "network-vif-deleted", "tag": "1efbdb28-4c1d-4e61-be86-3eade588e95d"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:22.682504 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-70db6254-7b23-4ec6-9ce2-f11069a4aeab req-028c5a6e-eb2d-49c3-965f-bea0d45ffc7d service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:22.686279 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-70db6254-7b23-4ec6-9ce2-f11069a4aeab req-028c5a6e-eb2d-49c3-965f-bea0d45ffc7d service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:22.705638 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-70db6254-7b23-4ec6-9ce2-f11069a4aeab req-028c5a6e-eb2d-49c3-965f-bea0d45ffc7d service nova] Creating event network-vif-deleted:1efbdb28-4c1d-4e61-be86-3eade588e95d for instance 45393090-60ab-4485-af6c-8e4f8fbbfef4 on hv-cinder-84773 Jun 27 09:39:22.714844 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-70db6254-7b23-4ec6-9ce2-f11069a4aeab req-028c5a6e-eb2d-49c3-965f-bea0d45ffc7d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044118 Jun 27 09:39:22.714844 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 214/412] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:39:22.975032 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-cf00aaca-ad3b-49e7-a293-560f725778a3 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:22.975744 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-cf00aaca-ad3b-49e7-a293-560f725778a3 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:22.982899 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cf00aaca-ad3b-49e7-a293-560f725778a3 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:22.983970 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cf00aaca-ad3b-49e7-a293-560f725778a3 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:22.984759 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cf00aaca-ad3b-49e7-a293-560f725778a3 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:22.985195 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cf00aaca-ad3b-49e7-a293-560f725778a3 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:23.081192 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-cf00aaca-ad3b-49e7-a293-560f725778a3 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:23.100331 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-cf00aaca-ad3b-49e7-a293-560f725778a3 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1309 microversion: 2.1 time: 0.128340 Jun 27 09:39:23.100513 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 199/413] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:22 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1309 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:23.134874 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f6e45c33-ce13-4366-ac98-f777f96d3d96 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:23.135624 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-f6e45c33-ce13-4366-ac98-f777f96d3d96 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:23.146920 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f6e45c33-ce13-4366-ac98-f777f96d3d96 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:23.151388 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f6e45c33-ce13-4366-ac98-f777f96d3d96 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:23.153298 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f6e45c33-ce13-4366-ac98-f777f96d3d96 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:23.153913 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f6e45c33-ce13-4366-ac98-f777f96d3d96 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:23.454583 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f6e45c33-ce13-4366-ac98-f777f96d3d96 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:23.472496 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-f6e45c33-ce13-4366-ac98-f777f96d3d96 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1502 microversion: 2.1 time: 0.343195 Jun 27 09:39:23.476098 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 215/414] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:23 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1502 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:23.497473 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-b4e9f4fa-93f8-4f33-a8f9-8cdc2cb31296 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:23.498307 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-b4e9f4fa-93f8-4f33-a8f9-8cdc2cb31296 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:23.506082 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b4e9f4fa-93f8-4f33-a8f9-8cdc2cb31296 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:23.506802 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b4e9f4fa-93f8-4f33-a8f9-8cdc2cb31296 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:23.507807 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b4e9f4fa-93f8-4f33-a8f9-8cdc2cb31296 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:23.509103 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b4e9f4fa-93f8-4f33-a8f9-8cdc2cb31296 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:23.546075 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-0a3de7f0-294c-45b8-a654-301552186df0 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:23.546702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-0a3de7f0-294c-45b8-a654-301552186df0 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:23.561483 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0a3de7f0-294c-45b8-a654-301552186df0 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:23.562185 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0a3de7f0-294c-45b8-a654-301552186df0 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:23.563057 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0a3de7f0-294c-45b8-a654-301552186df0 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:23.564366 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0a3de7f0-294c-45b8-a654-301552186df0 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:23.706046 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-0a3de7f0-294c-45b8-a654-301552186df0 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:23.717426 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-0a3de7f0-294c-45b8-a654-301552186df0 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1427 microversion: 2.1 time: 0.178947 Jun 27 09:39:23.719004 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 216/415] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:23 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1427 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:23.787297 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-b4e9f4fa-93f8-4f33-a8f9-8cdc2cb31296 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:23.792468 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:23.807742 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-b4e9f4fa-93f8-4f33-a8f9-8cdc2cb31296 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:23.815737 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-b4e9f4fa-93f8-4f33-a8f9-8cdc2cb31296 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:23.826026 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-b4e9f4fa-93f8-4f33-a8f9-8cdc2cb31296 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.332392 Jun 27 09:39:23.842840 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 200/416] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:23 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:24.117684 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-499fdaaf-a38d-4521-b1c3-a77024228dcc tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:24.118379 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-499fdaaf-a38d-4521-b1c3-a77024228dcc tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:24.140533 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-499fdaaf-a38d-4521-b1c3-a77024228dcc tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:24.141640 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-499fdaaf-a38d-4521-b1c3-a77024228dcc tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:24.145293 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-499fdaaf-a38d-4521-b1c3-a77024228dcc tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:24.145748 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-499fdaaf-a38d-4521-b1c3-a77024228dcc tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:24.435199 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-499fdaaf-a38d-4521-b1c3-a77024228dcc tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:24.455514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-499fdaaf-a38d-4521-b1c3-a77024228dcc tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1309 microversion: 2.1 time: 0.342340 Jun 27 09:39:24.468037 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 217/417] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:24 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1309 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:24.497592 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-902d3e06-8ba4-487f-b275-f976e8f684e8 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:24.498774 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-902d3e06-8ba4-487f-b275-f976e8f684e8 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:24.545515 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-902d3e06-8ba4-487f-b275-f976e8f684e8 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:24.545976 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-902d3e06-8ba4-487f-b275-f976e8f684e8 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:24.546767 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-902d3e06-8ba4-487f-b275-f976e8f684e8 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:24.547214 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-902d3e06-8ba4-487f-b275-f976e8f684e8 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:24.735454 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-8b24e382-fe1a-4873-9fee-2f4e8598af61 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:24.742142 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-8b24e382-fe1a-4873-9fee-2f4e8598af61 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:24.751744 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8b24e382-fe1a-4873-9fee-2f4e8598af61 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:24.753190 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8b24e382-fe1a-4873-9fee-2f4e8598af61 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:24.754218 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8b24e382-fe1a-4873-9fee-2f4e8598af61 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:24.754812 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8b24e382-fe1a-4873-9fee-2f4e8598af61 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:24.851023 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-902d3e06-8ba4-487f-b275-f976e8f684e8 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:24.861413 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-902d3e06-8ba4-487f-b275-f976e8f684e8 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1502 microversion: 2.1 time: 0.372503 Jun 27 09:39:24.880248 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 201/418] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:24 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1502 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:24.887632 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-8b24e382-fe1a-4873-9fee-2f4e8598af61 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf2758dad91482ea5da6bfdb5896313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb2a1214a1a4ae5a5211c18c2c39c1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:24.892374 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-91649067-77f4-4615-90e1-357151eb5ad9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:24.893002 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-91649067-77f4-4615-90e1-357151eb5ad9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:24.902230 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-8b24e382-fe1a-4873-9fee-2f4e8598af61 tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 200 len: 1298 microversion: 2.1 time: 0.167259 Jun 27 09:39:24.906063 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 218/419] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:24 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 1298 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:24.909165 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-91649067-77f4-4615-90e1-357151eb5ad9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:24.909654 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-91649067-77f4-4615-90e1-357151eb5ad9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:24.912305 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-91649067-77f4-4615-90e1-357151eb5ad9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:24.912749 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-91649067-77f4-4615-90e1-357151eb5ad9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:25.201830 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f6002820-4233-480f-9bf4-5a6007f6d8d7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-91902745", "imageRef": "96dfa32c-d52f-4225-8918-743ebc97f4bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "44332445-ecaa-4205-9b0a-eb56bcdc88ee"}], "security_groups": [{"name": "tempest-securitygroup--1932875344"}], "key_name": "tempest-keypair-2143385650", "user_data": "}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:25.238372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-91649067-77f4-4615-90e1-357151eb5ad9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:25.254271 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-91649067-77f4-4615-90e1-357151eb5ad9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:25.259292 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-91649067-77f4-4615-90e1-357151eb5ad9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:25.261356 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-91649067-77f4-4615-90e1-357151eb5ad9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.388477 Jun 27 09:39:25.264498 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 202/420] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:24 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:25.467845 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.network.neutron [None req-f6002820-4233-480f-9bf4-5a6007f6d8d7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] validate_networks() for [('44332445-ecaa-4205-9b0a-eb56bcdc88ee', None, None, None, None, None)] {{(pid=124869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 09:39:25.512227 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-278377fb-b7b9-484e-a25d-888d2d7dc611 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:25.517038 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-278377fb-b7b9-484e-a25d-888d2d7dc611 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:25.547292 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-278377fb-b7b9-484e-a25d-888d2d7dc611 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:25.548139 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-278377fb-b7b9-484e-a25d-888d2d7dc611 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:25.549100 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-278377fb-b7b9-484e-a25d-888d2d7dc611 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:25.549938 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-278377fb-b7b9-484e-a25d-888d2d7dc611 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:25.858805 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-278377fb-b7b9-484e-a25d-888d2d7dc611 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:25.883083 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-278377fb-b7b9-484e-a25d-888d2d7dc611 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1309 microversion: 2.1 time: 0.390989 Jun 27 09:39:25.892948 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 203/421] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:25 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1309 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:25.899003 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e406c2ae-249e-4ffe-927c-7f01bc55817e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:25.906973 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e406c2ae-249e-4ffe-927c-7f01bc55817e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:25.934594 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e406c2ae-249e-4ffe-927c-7f01bc55817e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:25.935264 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e406c2ae-249e-4ffe-927c-7f01bc55817e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:25.936253 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e406c2ae-249e-4ffe-927c-7f01bc55817e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:25.937191 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e406c2ae-249e-4ffe-927c-7f01bc55817e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:26.799650 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-e406c2ae-249e-4ffe-927c-7f01bc55817e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:26.810485 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-f6002820-4233-480f-9bf4-5a6007f6d8d7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Flavor limits 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 09:39:26.810979 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-f6002820-4233-480f-9bf4-5a6007f6d8d7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Image limits 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 09:39:26.811370 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-f6002820-4233-480f-9bf4-5a6007f6d8d7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Flavor pref 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 09:39:26.811915 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-f6002820-4233-480f-9bf4-5a6007f6d8d7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Image pref 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 09:39:26.812517 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-f6002820-4233-480f-9bf4-5a6007f6d8d7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 09:39:26.822589 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f6002820-4233-480f-9bf4-5a6007f6d8d7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:26.823313 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f6002820-4233-480f-9bf4-5a6007f6d8d7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:26.824320 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f6002820-4233-480f-9bf4-5a6007f6d8d7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:26.829178 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e406c2ae-249e-4ffe-927c-7f01bc55817e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1502 microversion: 2.1 time: 0.933573 Jun 27 09:39:26.834943 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f6002820-4233-480f-9bf4-5a6007f6d8d7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:26.835100 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 204/422] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:25 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1502 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:26.853971 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-dfc7547c-adbc-4530-a608-f70668bfe9eb tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:26.856202 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-dfc7547c-adbc-4530-a608-f70668bfe9eb tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] [instance: 45393090-60ab-4485-af6c-8e4f8fbbfef4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:26.866452 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-f6002820-4233-480f-9bf4-5a6007f6d8d7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Getting quotas for project 4b698ead017b4ef8b397ee127b487309. Resources: {'ram', 'instances', 'cores'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:39:26.874336 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dfc7547c-adbc-4530-a608-f70668bfe9eb tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:26.875189 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dfc7547c-adbc-4530-a608-f70668bfe9eb tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:26.878718 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dfc7547c-adbc-4530-a608-f70668bfe9eb tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:26.879162 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dfc7547c-adbc-4530-a608-f70668bfe9eb tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:26.881696 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-f6002820-4233-480f-9bf4-5a6007f6d8d7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Getting quotas for user cc8a087e97424d2890952be33695378f and project 4b698ead017b4ef8b397ee127b487309. Resources: {'ram', 'instances', 'cores'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:39:26.921147 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-f6002820-4233-480f-9bf4-5a6007f6d8d7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Going to run 1 instances... {{(pid=124869) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 09:39:26.923910 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-f6002820-4233-480f-9bf4-5a6007f6d8d7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96dfa32c-d52f-4225-8918-743ebc97f4bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 09:39:26.959261 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-dfc7547c-adbc-4530-a608-f70668bfe9eb tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] HTTP exception thrown: Instance 45393090-60ab-4485-af6c-8e4f8fbbfef4 could not be found. Jun 27 09:39:26.961780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-dfc7547c-adbc-4530-a608-f70668bfe9eb tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Request method failure captured: Jun 27 09:39:26.961780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 HTTP/1.1 Jun 27 09:39:26.961780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:39:26.961780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:39:26.961780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:39:26.961780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:39:26.961780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:39:26.961780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:39:26.961780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:39:26.961780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:39:26.961780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXqgMTf8-R2mic727tYyHIMjCF6jE1TKojdGVw92iduc-j1WjvRujmp0-XJbgvq9Cs-KbQh8JlgZ72fI6uYlRaCKBZi7alSIh18rudcv6JjhwLzUuHpUeTpUMUi106QOx1n1b94izsCtz6kr3lqSebSH3_5miK3PjgwLx6za66xblYs Jun 27 09:39:26.961780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:39:26.961780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:39:26.961780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:39:26.961780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:39:26.961780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:39:26.961780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:39:26.961780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: 0eb2a1214a1a4ae5a5211c18c2c39c1a Jun 27 09:39:26.961780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-VolumesNegativeTest-1091397669 Jun 27 09:39:26.961780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:39:26.961780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:39:26.964612 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0eb2a1214a1a4ae5a5211c18c2c39c1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0eb2a1214a1a4ae5a5211c18c2c39c1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0eb2a1214a1a4ae5a5211c18c2c39c1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0eb2a1214a1a4ae5a5211c18c2c39c1a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:39:26.964612 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-VolumesNegativeTest-1091397669 Jun 27 09:39:26.964612 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: 0eb2a1214a1a4ae5a5211c18c2c39c1a Jun 27 09:39:26.964612 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-VolumesNegativeTest-1091397669 Jun 27 09:39:26.964612 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-VolumesNegativeTest-1091397669-project Jun 27 09:39:26.964612 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:39:26.964612 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:39:26.964612 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: fdf2758dad91482ea5da6bfdb5896313 Jun 27 09:39:26.964612 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-VolumesNegativeTest-1091397669-project Jun 27 09:39:26.964612 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: > Jun 27 09:39:26.964612 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Instance 45393090-60ab-4485-af6c-8e4f8fbbfef4 could not be found. Jun 27 09:39:26.964612 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': '45393090-60ab-4485-af6c-8e4f8fbbfef4'} Jun 27 09:39:26.965351 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:39:26.965351 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:39:26.965351 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:39:26.965351 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:39:26.965351 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:39:26.965351 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:39:26.965351 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:39:26.965351 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:39:26.965351 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:39:26.965351 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:39:26.965351 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45393090-60ab-4485-af6c-8e4f8fbbfef4 could not be found. Jun 27 09:39:26.965351 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:39:26.965351 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:39:26.965351 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:39:26.965351 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:39:26.965351 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:39:26.965351 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:39:26.965351 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:39:26.965351 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:39:26.965351 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:39:26.966639 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:39:26.966639 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:39:26.966639 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:39:26.966639 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:39:26.966639 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:39:26.966639 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:39:26.966639 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:39:26.966639 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45393090-60ab-4485-af6c-8e4f8fbbfef4 could not be found. Jun 27 09:39:26.966639 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:39:26.966639 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:39:26.966639 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:39:26.966639 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:39:26.966639 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:39:26.966639 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:39:26.966639 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:39:26.966639 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:39:26.966639 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45393090-60ab-4485-af6c-8e4f8fbbfef4 could not be found. Jun 27 09:39:26.966639 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:39:26.967966 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-dfc7547c-adbc-4530-a608-f70668bfe9eb tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] Returning 404 to user: Instance 45393090-60ab-4485-af6c-8e4f8fbbfef4 could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:39:26.967966 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-dfc7547c-adbc-4530-a608-f70668bfe9eb tempest-VolumesNegativeTest-1091397669 tempest-VolumesNegativeTest-1091397669-project] 10.222.0.64 "GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4" status: 404 len: 111 microversion: 2.1 time: 0.120697 Jun 27 09:39:26.974469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 205/423] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:26 2022] GET /compute/v2.1/servers/45393090-60ab-4485-af6c-8e4f8fbbfef4 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:39:26.986375 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-8069a531-415a-4ef3-ab56-465610239f6b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:26.987102 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-8069a531-415a-4ef3-ab56-465610239f6b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:26.994032 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8069a531-415a-4ef3-ab56-465610239f6b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:26.994472 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8069a531-415a-4ef3-ab56-465610239f6b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:26.995243 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8069a531-415a-4ef3-ab56-465610239f6b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:27.006336 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8069a531-415a-4ef3-ab56-465610239f6b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:27.146864 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-f6002820-4233-480f-9bf4-5a6007f6d8d7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.949373 Jun 27 09:39:27.154241 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 219/424] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 27 09:39:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 09:39:27.162613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-7e75f590-ff29-40b5-ab26-75da171d9760 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:27.164725 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-7e75f590-ff29-40b5-ab26-75da171d9760 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:27.185271 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7e75f590-ff29-40b5-ab26-75da171d9760 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:27.189789 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7e75f590-ff29-40b5-ab26-75da171d9760 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:27.192191 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7e75f590-ff29-40b5-ab26-75da171d9760 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:27.193497 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7e75f590-ff29-40b5-ab26-75da171d9760 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:27.484120 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-7e75f590-ff29-40b5-ab26-75da171d9760 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:27.494939 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-7e75f590-ff29-40b5-ab26-75da171d9760 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1315 microversion: 2.1 time: 0.339043 Jun 27 09:39:27.497070 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 220/425] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:27 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:27.520730 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-6c95d747-1d28-41f6-bad3-e0d1aee518f5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:27.522951 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-6c95d747-1d28-41f6-bad3-e0d1aee518f5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:27.687796 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6c95d747-1d28-41f6-bad3-e0d1aee518f5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:27.697671 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-6c95d747-1d28-41f6-bad3-e0d1aee518f5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1240 microversion: 2.1 time: 0.190279 Jun 27 09:39:27.710694 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 221/426] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:27 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1240 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:27.847153 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-6ea85611-3947-440e-83f4-2285dbed5dd2 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:27.847901 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-6ea85611-3947-440e-83f4-2285dbed5dd2 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:27.873022 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6ea85611-3947-440e-83f4-2285dbed5dd2 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:27.874769 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6ea85611-3947-440e-83f4-2285dbed5dd2 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:27.874769 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6ea85611-3947-440e-83f4-2285dbed5dd2 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:27.874769 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6ea85611-3947-440e-83f4-2285dbed5dd2 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:28.029598 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=2 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:28.036599 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6ea85611-3947-440e-83f4-2285dbed5dd2 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:28.048052 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-6ea85611-3947-440e-83f4-2285dbed5dd2 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1460 microversion: 2.1 time: 0.201162 Jun 27 09:39:28.048052 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 222/427] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:27 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1460 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:28.051988 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-540426b7-4785-4105-84fc-192af311c4f0 req-ae2ef048-fd45-4c99-846a-eaa6a38163e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "150e9347-3eae-4d8c-8b7e-24ac9f867f1f", "name": "network-vif-deleted", "tag": "d213adbe-5b3f-4aea-a20c-fc98a6690d24"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:28.067416 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-540426b7-4785-4105-84fc-192af311c4f0 req-ae2ef048-fd45-4c99-846a-eaa6a38163e0 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:28.068185 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-540426b7-4785-4105-84fc-192af311c4f0 req-ae2ef048-fd45-4c99-846a-eaa6a38163e0 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:28.085013 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-540426b7-4785-4105-84fc-192af311c4f0 req-ae2ef048-fd45-4c99-846a-eaa6a38163e0 service nova] Creating event network-vif-deleted:d213adbe-5b3f-4aea-a20c-fc98a6690d24 for instance 150e9347-3eae-4d8c-8b7e-24ac9f867f1f on hv-cinder-84773 Jun 27 09:39:28.094878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-540426b7-4785-4105-84fc-192af311c4f0 req-ae2ef048-fd45-4c99-846a-eaa6a38163e0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048419 Jun 27 09:39:28.096273 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 223/428] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:39:28.101259 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8069a531-415a-4ef3-ab56-465610239f6b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:28.110054 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=10 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:28.113974 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8069a531-415a-4ef3-ab56-465610239f6b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:28.116787 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8069a531-415a-4ef3-ab56-465610239f6b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:28.119338 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-8069a531-415a-4ef3-ab56-465610239f6b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 1.143653 Jun 27 09:39:28.121950 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 206/429] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:26 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:28.514877 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-573b02dc-f8d5-460c-bc10-d6a261b83efc tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:28.515792 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-573b02dc-f8d5-460c-bc10-d6a261b83efc tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:28.522940 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-573b02dc-f8d5-460c-bc10-d6a261b83efc tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:28.523408 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-573b02dc-f8d5-460c-bc10-d6a261b83efc tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:28.524564 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-573b02dc-f8d5-460c-bc10-d6a261b83efc tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:28.524661 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-573b02dc-f8d5-460c-bc10-d6a261b83efc tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:28.649548 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-573b02dc-f8d5-460c-bc10-d6a261b83efc tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:28.661654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=100 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:28.671748 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-573b02dc-f8d5-460c-bc10-d6a261b83efc tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1315 microversion: 2.1 time: 0.159457 Jun 27 09:39:28.673582 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 224/430] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:28 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:28.727799 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e1101fe9-9cc5-42b7-8a08-64ee25d8288b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:28.728419 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e1101fe9-9cc5-42b7-8a08-64ee25d8288b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:28.749308 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e1101fe9-9cc5-42b7-8a08-64ee25d8288b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:28.749757 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e1101fe9-9cc5-42b7-8a08-64ee25d8288b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:28.750535 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e1101fe9-9cc5-42b7-8a08-64ee25d8288b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:28.750999 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e1101fe9-9cc5-42b7-8a08-64ee25d8288b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:28.942407 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-e1101fe9-9cc5-42b7-8a08-64ee25d8288b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:28.968365 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e1101fe9-9cc5-42b7-8a08-64ee25d8288b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1244 microversion: 2.1 time: 0.245508 Jun 27 09:39:28.980542 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 207/431] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:28 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1244 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:29.065288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f818ef45-ea77-4cf6-b6b1-343e0f5c15e2 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:29.065904 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-f818ef45-ea77-4cf6-b6b1-343e0f5c15e2 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:29.078881 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f818ef45-ea77-4cf6-b6b1-343e0f5c15e2 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:29.088957 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f818ef45-ea77-4cf6-b6b1-343e0f5c15e2 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:29.090045 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f818ef45-ea77-4cf6-b6b1-343e0f5c15e2 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:29.095492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f818ef45-ea77-4cf6-b6b1-343e0f5c15e2 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:29.140272 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-eaac5d2f-fc60-4b42-a97e-cdca26e0bd21 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:29.140962 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-eaac5d2f-fc60-4b42-a97e-cdca26e0bd21 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:29.148534 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-eaac5d2f-fc60-4b42-a97e-cdca26e0bd21 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:29.170597 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-eaac5d2f-fc60-4b42-a97e-cdca26e0bd21 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:29.172001 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-eaac5d2f-fc60-4b42-a97e-cdca26e0bd21 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:29.172506 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-eaac5d2f-fc60-4b42-a97e-cdca26e0bd21 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:29.182394 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f818ef45-ea77-4cf6-b6b1-343e0f5c15e2 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:29.182394 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f818ef45-ea77-4cf6-b6b1-343e0f5c15e2 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:29.182394 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.objects.instance [None req-f818ef45-ea77-4cf6-b6b1-343e0f5c15e2 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lazy-loading 'fault' on Instance uuid 150e9347-3eae-4d8c-8b7e-24ac9f867f1f {{(pid=124869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:39:29.402308 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f818ef45-ea77-4cf6-b6b1-343e0f5c15e2 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:29.413239 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-f818ef45-ea77-4cf6-b6b1-343e0f5c15e2 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 200 len: 1302 microversion: 2.1 time: 0.353078 Jun 27 09:39:29.420389 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 225/432] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:29 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 1302 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:29.689359 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-82387e10-a353-4636-9585-8f267001e692 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:29.690152 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-82387e10-a353-4636-9585-8f267001e692 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:29.703645 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-82387e10-a353-4636-9585-8f267001e692 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:29.706200 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-82387e10-a353-4636-9585-8f267001e692 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:29.707481 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-82387e10-a353-4636-9585-8f267001e692 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:29.709672 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-82387e10-a353-4636-9585-8f267001e692 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:29.788542 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-eaac5d2f-fc60-4b42-a97e-cdca26e0bd21 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:29.798050 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-eaac5d2f-fc60-4b42-a97e-cdca26e0bd21 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:29.799572 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-eaac5d2f-fc60-4b42-a97e-cdca26e0bd21 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:29.822532 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-eaac5d2f-fc60-4b42-a97e-cdca26e0bd21 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.681065 Jun 27 09:39:29.841461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 208/433] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:29 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:39:29.990308 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c21ba7aa-47bd-470c-893a-30c15e20b1c1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:29.990930 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-c21ba7aa-47bd-470c-893a-30c15e20b1c1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:29.994463 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:30.010847 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c21ba7aa-47bd-470c-893a-30c15e20b1c1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:30.012976 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c21ba7aa-47bd-470c-893a-30c15e20b1c1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:30.017812 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c21ba7aa-47bd-470c-893a-30c15e20b1c1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:30.018313 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c21ba7aa-47bd-470c-893a-30c15e20b1c1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:30.066078 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-82387e10-a353-4636-9585-8f267001e692 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:30.088231 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-82387e10-a353-4636-9585-8f267001e692 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1357 microversion: 2.1 time: 0.402563 Jun 27 09:39:30.098234 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 226/434] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:29 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1357 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:30.139671 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-c21ba7aa-47bd-470c-893a-30c15e20b1c1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:30.147772 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-c21ba7aa-47bd-470c-893a-30c15e20b1c1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1292 microversion: 2.1 time: 0.163937 Jun 27 09:39:30.148951 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 209/435] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:29 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1292 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:30.438754 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-ccf98ecc-da13-456e-b75d-4080617e4aed tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:30.440032 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-ccf98ecc-da13-456e-b75d-4080617e4aed tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: 150e9347-3eae-4d8c-8b7e-24ac9f867f1f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:30.456685 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ccf98ecc-da13-456e-b75d-4080617e4aed tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:30.458739 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ccf98ecc-da13-456e-b75d-4080617e4aed tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:30.465615 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ccf98ecc-da13-456e-b75d-4080617e4aed tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:30.471505 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ccf98ecc-da13-456e-b75d-4080617e4aed tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:30.502541 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-ccf98ecc-da13-456e-b75d-4080617e4aed tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] HTTP exception thrown: Instance 150e9347-3eae-4d8c-8b7e-24ac9f867f1f could not be found. Jun 27 09:39:30.504963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-ccf98ecc-da13-456e-b75d-4080617e4aed tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Request method failure captured: Jun 27 09:39:30.504963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f HTTP/1.1 Jun 27 09:39:30.504963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:39:30.504963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:39:30.504963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:39:30.504963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:39:30.504963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:39:30.504963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:39:30.504963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:39:30.504963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:39:30.504963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXqi-ehhcSy_2jmYXAVB8mquIZm6y-d9lRH8ZCRZLUXd2NbyI8ZcLyxVx6B-JLsydlbHauSeQGvCjy2FlPWgyoKTFcS82xXENu6a4q5U6V-aZNM1EPrs3bNCV-B2uYrEzcutZjkHPSrG7OpP4ligWW18A6UOHJ6YdP5vx4jcVQ9Xb_E Jun 27 09:39:30.504963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:39:30.504963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:39:30.504963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:39:30.504963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:39:30.504963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:39:30.504963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:39:30.504963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: 604921be35cc4c258933114a5535800c Jun 27 09:39:30.504963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-VolumesActionsTest-2055227002 Jun 27 09:39:30.504963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:39:30.504963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:39:30.506478 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/604921be35cc4c258933114a5535800c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/604921be35cc4c258933114a5535800c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/604921be35cc4c258933114a5535800c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_604921be35cc4c258933114a5535800c", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:39:30.506478 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-VolumesActionsTest-2055227002 Jun 27 09:39:30.506478 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: 604921be35cc4c258933114a5535800c Jun 27 09:39:30.506478 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-VolumesActionsTest-2055227002 Jun 27 09:39:30.506478 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-VolumesActionsTest-2055227002-project Jun 27 09:39:30.506478 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:39:30.506478 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:39:30.506478 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: 09f242a8f51545199a159f6992ee74f1 Jun 27 09:39:30.506478 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-VolumesActionsTest-2055227002-project Jun 27 09:39:30.506478 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: > Jun 27 09:39:30.506478 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Instance 150e9347-3eae-4d8c-8b7e-24ac9f867f1f could not be found. Jun 27 09:39:30.506478 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'id': '150e9347-3eae-4d8c-8b7e-24ac9f867f1f'} Jun 27 09:39:30.507372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:39:30.507372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:39:30.507372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:39:30.507372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:39:30.507372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:39:30.507372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:39:30.507372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:39:30.507372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:39:30.507372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:39:30.507372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:39:30.507372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 150e9347-3eae-4d8c-8b7e-24ac9f867f1f could not be found. Jun 27 09:39:30.507372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:39:30.507372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:39:30.507372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:39:30.507372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:39:30.507372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:39:30.507372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:39:30.507372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:39:30.507372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:39:30.507372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:39:30.509285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:39:30.509285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:39:30.509285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:39:30.509285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:39:30.509285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:39:30.509285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:39:30.509285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:39:30.509285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 150e9347-3eae-4d8c-8b7e-24ac9f867f1f could not be found. Jun 27 09:39:30.509285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:39:30.509285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:39:30.509285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:39:30.509285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:39:30.509285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:39:30.509285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:39:30.509285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:39:30.509285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:39:30.509285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 150e9347-3eae-4d8c-8b7e-24ac9f867f1f could not be found. Jun 27 09:39:30.509285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:39:30.511597 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-ccf98ecc-da13-456e-b75d-4080617e4aed tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Returning 404 to user: Instance 150e9347-3eae-4d8c-8b7e-24ac9f867f1f could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:39:30.512911 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-ccf98ecc-da13-456e-b75d-4080617e4aed tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f" status: 404 len: 111 microversion: 2.1 time: 0.080225 Jun 27 09:39:30.536212 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 227/436] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:30 2022] GET /compute/v2.1/servers/150e9347-3eae-4d8c-8b7e-24ac9f867f1f => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:39:30.690081 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-5ae642cd-e1d5-4919-a406-f98aab5d3584 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1718074766", "imageRef": "96dfa32c-d52f-4225-8918-743ebc97f4bc", "flavorRef": "452", "networks": [{"uuid": "8dc842b0-c4e3-4553-aa78-54073ba34630"}]}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:30.853456 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-b0d7cc4b-1f73-4d47-af03-d74bd20f48d8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:30.854774 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-b0d7cc4b-1f73-4d47-af03-d74bd20f48d8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:30.865106 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b0d7cc4b-1f73-4d47-af03-d74bd20f48d8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:30.865956 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b0d7cc4b-1f73-4d47-af03-d74bd20f48d8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:30.866949 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b0d7cc4b-1f73-4d47-af03-d74bd20f48d8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:30.868219 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b0d7cc4b-1f73-4d47-af03-d74bd20f48d8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:31.392117 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-b0d7cc4b-1f73-4d47-af03-d74bd20f48d8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:31.392117 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-b0d7cc4b-1f73-4d47-af03-d74bd20f48d8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:31.395581 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-b0d7cc4b-1f73-4d47-af03-d74bd20f48d8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:31.395581 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-b0d7cc4b-1f73-4d47-af03-d74bd20f48d8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.499960 Jun 27 09:39:31.395581 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 228/437] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:30 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:31.395581 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-75a55fe9-c459-40d9-832e-c3e524c3cccd tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:31.395954 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-75a55fe9-c459-40d9-832e-c3e524c3cccd tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:31.395954 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-75a55fe9-c459-40d9-832e-c3e524c3cccd tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:31.395954 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-75a55fe9-c459-40d9-832e-c3e524c3cccd tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:31.395954 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-75a55fe9-c459-40d9-832e-c3e524c3cccd tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:31.396294 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-75a55fe9-c459-40d9-832e-c3e524c3cccd tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:31.711121 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-75a55fe9-c459-40d9-832e-c3e524c3cccd tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:31.711121 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-75a55fe9-c459-40d9-832e-c3e524c3cccd tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1357 microversion: 2.1 time: 0.359490 Jun 27 09:39:31.711121 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 229/438] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:31 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1357 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:31.728272 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-7462d6ec-68c1-4ff6-a23a-58e71c2c81b2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:31.728945 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-7462d6ec-68c1-4ff6-a23a-58e71c2c81b2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:31.730978 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:31.736289 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7462d6ec-68c1-4ff6-a23a-58e71c2c81b2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:31.736992 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7462d6ec-68c1-4ff6-a23a-58e71c2c81b2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:31.737957 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7462d6ec-68c1-4ff6-a23a-58e71c2c81b2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:31.738566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7462d6ec-68c1-4ff6-a23a-58e71c2c81b2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:31.914569 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-7462d6ec-68c1-4ff6-a23a-58e71c2c81b2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:31.929366 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-7462d6ec-68c1-4ff6-a23a-58e71c2c81b2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1292 microversion: 2.1 time: 0.205804 Jun 27 09:39:31.931116 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 230/439] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:31 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1292 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:31.941177 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-72c4297c-a537-4bfc-9957-6384f78bdce8 req-79a8e03c-8939-4fdf-a70b-79c389d05de6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129", "tag": "b7d364ab-ebca-4312-8213-6c5cc722e7bc"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:31.986618 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-72c4297c-a537-4bfc-9957-6384f78bdce8 req-79a8e03c-8939-4fdf-a70b-79c389d05de6 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:31.987084 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-72c4297c-a537-4bfc-9957-6384f78bdce8 req-79a8e03c-8939-4fdf-a70b-79c389d05de6 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:32.049789 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-72c4297c-a537-4bfc-9957-6384f78bdce8 req-79a8e03c-8939-4fdf-a70b-79c389d05de6 service nova] Creating event network-changed:b7d364ab-ebca-4312-8213-6c5cc722e7bc for instance b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 on hv-cinder-84773 Jun 27 09:39:32.060029 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.network.neutron [None req-5ae642cd-e1d5-4919-a406-f98aab5d3584 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] validate_networks() for [('8dc842b0-c4e3-4553-aa78-54073ba34630', None, None, None, None, None)] {{(pid=124870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 09:39:32.074169 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-72c4297c-a537-4bfc-9957-6384f78bdce8 req-79a8e03c-8939-4fdf-a70b-79c389d05de6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140147 Jun 27 09:39:32.074169 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 231/440] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:39:32.372688 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e5a41bc5-f164-485c-8d15-24d48f42026b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:32.373528 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-e5a41bc5-f164-485c-8d15-24d48f42026b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:32.405107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e5a41bc5-f164-485c-8d15-24d48f42026b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:32.405759 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e5a41bc5-f164-485c-8d15-24d48f42026b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:32.406334 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e5a41bc5-f164-485c-8d15-24d48f42026b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:32.406769 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e5a41bc5-f164-485c-8d15-24d48f42026b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:32.848725 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-5ae642cd-e1d5-4919-a406-f98aab5d3584 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Flavor limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 09:39:32.849510 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-5ae642cd-e1d5-4919-a406-f98aab5d3584 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Image limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 09:39:32.850387 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-5ae642cd-e1d5-4919-a406-f98aab5d3584 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Flavor pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 09:39:32.851320 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-5ae642cd-e1d5-4919-a406-f98aab5d3584 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Image pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 09:39:32.852590 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-5ae642cd-e1d5-4919-a406-f98aab5d3584 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 09:39:32.876348 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5ae642cd-e1d5-4919-a406-f98aab5d3584 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:32.877299 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5ae642cd-e1d5-4919-a406-f98aab5d3584 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:32.879144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5ae642cd-e1d5-4919-a406-f98aab5d3584 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:32.879934 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5ae642cd-e1d5-4919-a406-f98aab5d3584 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:32.901027 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-5ae642cd-e1d5-4919-a406-f98aab5d3584 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Getting quotas for project 604921be35cc4c258933114a5535800c. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:39:32.905679 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-5ae642cd-e1d5-4919-a406-f98aab5d3584 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Getting quotas for user 09f242a8f51545199a159f6992ee74f1 and project 604921be35cc4c258933114a5535800c. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:39:32.920232 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-5ae642cd-e1d5-4919-a406-f98aab5d3584 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Going to run 1 instances... {{(pid=124870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 09:39:32.922286 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-5ae642cd-e1d5-4919-a406-f98aab5d3584 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96dfa32c-d52f-4225-8918-743ebc97f4bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 09:39:33.107446 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e5a41bc5-f164-485c-8d15-24d48f42026b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:33.128742 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e5a41bc5-f164-485c-8d15-24d48f42026b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:33.131485 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e5a41bc5-f164-485c-8d15-24d48f42026b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:33.134616 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-e5a41bc5-f164-485c-8d15-24d48f42026b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.774094 Jun 27 09:39:33.143168 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-5ae642cd-e1d5-4919-a406-f98aab5d3584 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.453323 Jun 27 09:39:33.148140 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 232/441] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:32 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:39:33.148539 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 210/442] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 27 09:39:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 09:39:33.154628 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-93d924fb-0586-48b7-b890-ae75e9371d35 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:33.155516 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-93d924fb-0586-48b7-b890-ae75e9371d35 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:33.163135 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-93d924fb-0586-48b7-b890-ae75e9371d35 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:33.164497 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-93d924fb-0586-48b7-b890-ae75e9371d35 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:33.166405 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-93d924fb-0586-48b7-b890-ae75e9371d35 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:33.167700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-93d924fb-0586-48b7-b890-ae75e9371d35 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:33.170234 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-566db9a3-4ff6-42c0-946e-b5bca2991f91 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:33.174236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-566db9a3-4ff6-42c0-946e-b5bca2991f91 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:33.202030 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-566db9a3-4ff6-42c0-946e-b5bca2991f91 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:33.202030 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-566db9a3-4ff6-42c0-946e-b5bca2991f91 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:33.202030 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-566db9a3-4ff6-42c0-946e-b5bca2991f91 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:33.206134 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-566db9a3-4ff6-42c0-946e-b5bca2991f91 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:33.506305 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-566db9a3-4ff6-42c0-946e-b5bca2991f91 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:33.517955 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-566db9a3-4ff6-42c0-946e-b5bca2991f91 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1292 microversion: 2.1 time: 0.368104 Jun 27 09:39:33.527560 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 211/443] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:33 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1292 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:33.535168 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-93d924fb-0586-48b7-b890-ae75e9371d35 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:33.544847 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-5d19f804-3360-471a-b39e-ca7317e93b4e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:33.548421 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-5d19f804-3360-471a-b39e-ca7317e93b4e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:33.558111 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-93d924fb-0586-48b7-b890-ae75e9371d35 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1357 microversion: 2.1 time: 0.396872 Jun 27 09:39:33.558812 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 233/444] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:33 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1357 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:33.767807 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-5d19f804-3360-471a-b39e-ca7317e93b4e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:33.784114 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-5d19f804-3360-471a-b39e-ca7317e93b4e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 200 len: 1214 microversion: 2.1 time: 0.252962 Jun 27 09:39:33.785035 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 212/445] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:33 2022] GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 1214 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:34.154351 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-50138cb7-044c-4c91-a51d-d31567b93249 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:34.155339 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-50138cb7-044c-4c91-a51d-d31567b93249 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:34.167186 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-50138cb7-044c-4c91-a51d-d31567b93249 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:34.167683 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-50138cb7-044c-4c91-a51d-d31567b93249 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:34.168485 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-50138cb7-044c-4c91-a51d-d31567b93249 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:34.168924 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-50138cb7-044c-4c91-a51d-d31567b93249 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:34.495087 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-50138cb7-044c-4c91-a51d-d31567b93249 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:34.505359 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-50138cb7-044c-4c91-a51d-d31567b93249 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:34.506999 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-50138cb7-044c-4c91-a51d-d31567b93249 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:34.508378 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-50138cb7-044c-4c91-a51d-d31567b93249 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.357938 Jun 27 09:39:34.516504 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 234/446] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:34 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:34.545054 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-fc368709-d348-42ad-a52e-297cc34a01a2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:34.548968 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-fc368709-d348-42ad-a52e-297cc34a01a2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:34.552540 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fc368709-d348-42ad-a52e-297cc34a01a2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:34.553167 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fc368709-d348-42ad-a52e-297cc34a01a2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:34.554086 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fc368709-d348-42ad-a52e-297cc34a01a2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:34.554712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fc368709-d348-42ad-a52e-297cc34a01a2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:34.576178 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e2785a24-5ab9-4a71-968c-1b06e69ab1f1 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:34.576917 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-e2785a24-5ab9-4a71-968c-1b06e69ab1f1 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:34.589943 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e2785a24-5ab9-4a71-968c-1b06e69ab1f1 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:34.590414 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e2785a24-5ab9-4a71-968c-1b06e69ab1f1 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:34.591887 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e2785a24-5ab9-4a71-968c-1b06e69ab1f1 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:34.592508 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e2785a24-5ab9-4a71-968c-1b06e69ab1f1 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:34.662370 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-fc368709-d348-42ad-a52e-297cc34a01a2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:34.673304 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-fc368709-d348-42ad-a52e-297cc34a01a2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1298 microversion: 2.1 time: 0.132368 Jun 27 09:39:34.673950 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 213/447] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:34 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1298 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:34.808547 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-5c3caf13-de56-4a39-9668-7456a616ebc6 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:34.809762 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-5c3caf13-de56-4a39-9668-7456a616ebc6 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:34.822610 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5c3caf13-de56-4a39-9668-7456a616ebc6 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:34.823069 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5c3caf13-de56-4a39-9668-7456a616ebc6 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:34.825656 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5c3caf13-de56-4a39-9668-7456a616ebc6 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:34.826112 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5c3caf13-de56-4a39-9668-7456a616ebc6 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:34.986974 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e2785a24-5ab9-4a71-968c-1b06e69ab1f1 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:34.993284 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-5c3caf13-de56-4a39-9668-7456a616ebc6 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:35.020085 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-5c3caf13-de56-4a39-9668-7456a616ebc6 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 200 len: 1218 microversion: 2.1 time: 0.221573 Jun 27 09:39:35.020249 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-e2785a24-5ab9-4a71-968c-1b06e69ab1f1 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1357 microversion: 2.1 time: 0.424906 Jun 27 09:39:35.027194 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 214/448] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:34 2022] GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 1218 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:35.030522 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 235/449] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:34 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1357 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:35.528619 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-1f8c38d8-9e7c-4dc6-897c-5444e0bdbdee tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:35.537443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-1f8c38d8-9e7c-4dc6-897c-5444e0bdbdee tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:35.544745 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1f8c38d8-9e7c-4dc6-897c-5444e0bdbdee tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:35.547449 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1f8c38d8-9e7c-4dc6-897c-5444e0bdbdee tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:35.549386 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1f8c38d8-9e7c-4dc6-897c-5444e0bdbdee tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:35.550807 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1f8c38d8-9e7c-4dc6-897c-5444e0bdbdee tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:35.694825 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-448aaff8-10ea-4557-b42a-1bbb7dc77fd0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:35.695472 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-448aaff8-10ea-4557-b42a-1bbb7dc77fd0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:35.709889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-448aaff8-10ea-4557-b42a-1bbb7dc77fd0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:35.710330 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-448aaff8-10ea-4557-b42a-1bbb7dc77fd0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:35.714613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-448aaff8-10ea-4557-b42a-1bbb7dc77fd0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:35.715290 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-448aaff8-10ea-4557-b42a-1bbb7dc77fd0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:35.866420 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-448aaff8-10ea-4557-b42a-1bbb7dc77fd0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:35.875576 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-448aaff8-10ea-4557-b42a-1bbb7dc77fd0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1298 microversion: 2.1 time: 0.188656 Jun 27 09:39:35.880966 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 236/450] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:35 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1298 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:36.366650 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-6a0912c8-9e07-4ff7-82a4-0fca77af15f3 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Action: 'create', calling method: .version_select at 0x7ffa975c2f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-205470936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKw8nZ7xK6VIBL/XgPeg2E8CA9GMuqgNhYp8hnl3RHtJKCtfhTpnD7Xe4oUfI4KA6WlVq4J0PuQl6dP8Ul79aKsYXmbsyx/AHTlM9Hvyf5xn4j8e9dRdUhG094pvsQqxeg=="}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:36.387714 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-6a0912c8-9e07-4ff7-82a4-0fca77af15f3 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Getting quotas for project 1d5cbd080e204408aa51c29ec2cf1422. Resources: {'key_pairs'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:39:36.394053 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-6a0912c8-9e07-4ff7-82a4-0fca77af15f3 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Getting quotas for user 2720d45854ab4a61b3b22dd43a523d4b and project 1d5cbd080e204408aa51c29ec2cf1422. Resources: {'key_pairs'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:39:36.429050 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-1f8c38d8-9e7c-4dc6-897c-5444e0bdbdee tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:36.443699 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-1f8c38d8-9e7c-4dc6-897c-5444e0bdbdee tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:36.448718 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-1f8c38d8-9e7c-4dc6-897c-5444e0bdbdee tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:36.451755 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-1f8c38d8-9e7c-4dc6-897c-5444e0bdbdee tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.927835 Jun 27 09:39:36.453364 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 215/451] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:35 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:36.460384 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-7fdce23c-d778-4890-93af-cf5c5df3a911 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:36.462055 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-7fdce23c-d778-4890-93af-cf5c5df3a911 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:36.469638 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7fdce23c-d778-4890-93af-cf5c5df3a911 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:36.475394 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7fdce23c-d778-4890-93af-cf5c5df3a911 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:36.475394 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7fdce23c-d778-4890-93af-cf5c5df3a911 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:36.475394 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7fdce23c-d778-4890-93af-cf5c5df3a911 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:36.526282 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-6a0912c8-9e07-4ff7-82a4-0fca77af15f3 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.549582 Jun 27 09:39:36.532094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 237/452] 10.222.0.64 () {60 vars in 1158 bytes} [Mon Jun 27 09:39:35 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:39:36.538132 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-2e954b22-8349-43c0-bd38-d1305169868f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:36.538904 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-2e954b22-8349-43c0-bd38-d1305169868f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:36.548284 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2e954b22-8349-43c0-bd38-d1305169868f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:36.548756 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2e954b22-8349-43c0-bd38-d1305169868f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:36.550074 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2e954b22-8349-43c0-bd38-d1305169868f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:36.550533 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2e954b22-8349-43c0-bd38-d1305169868f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:36.585229 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-7fdce23c-d778-4890-93af-cf5c5df3a911 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:36.627435 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-7fdce23c-d778-4890-93af-cf5c5df3a911 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 200 len: 1210 microversion: 2.1 time: 0.172232 Jun 27 09:39:36.645378 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 216/453] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:36 2022] GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 1210 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:36.819004 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2e954b22-8349-43c0-bd38-d1305169868f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:36.832545 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-2e954b22-8349-43c0-bd38-d1305169868f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1357 microversion: 2.1 time: 0.301275 Jun 27 09:39:36.844019 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 238/454] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:36 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1357 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:36.906994 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-9c74fb1d-4471-42a9-a70a-f5e2ba945616 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:36.908045 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-9c74fb1d-4471-42a9-a70a-f5e2ba945616 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:36.917955 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9c74fb1d-4471-42a9-a70a-f5e2ba945616 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:36.918405 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9c74fb1d-4471-42a9-a70a-f5e2ba945616 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:36.919188 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9c74fb1d-4471-42a9-a70a-f5e2ba945616 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:36.919658 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9c74fb1d-4471-42a9-a70a-f5e2ba945616 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:37.059724 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-9c74fb1d-4471-42a9-a70a-f5e2ba945616 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:37.073613 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-9c74fb1d-4471-42a9-a70a-f5e2ba945616 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1298 microversion: 2.1 time: 0.181581 Jun 27 09:39:37.080850 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 217/455] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:36 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1298 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:37.467084 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell0:SELECT=2 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:37.476079 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-579f5306-f768-4600-bbbc-5e726b006918 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:37.477339 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-579f5306-f768-4600-bbbc-5e726b006918 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:37.494508 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-579f5306-f768-4600-bbbc-5e726b006918 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:37.497272 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-579f5306-f768-4600-bbbc-5e726b006918 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:37.497272 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-579f5306-f768-4600-bbbc-5e726b006918 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:37.497272 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-579f5306-f768-4600-bbbc-5e726b006918 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:37.645482 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-6aef6d4d-9f4f-4984-8226-f7ed6a4b03e1 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:37.646148 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-6aef6d4d-9f4f-4984-8226-f7ed6a4b03e1 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:37.659344 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6aef6d4d-9f4f-4984-8226-f7ed6a4b03e1 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:37.662010 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6aef6d4d-9f4f-4984-8226-f7ed6a4b03e1 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:37.663237 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6aef6d4d-9f4f-4984-8226-f7ed6a4b03e1 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:37.666772 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6aef6d4d-9f4f-4984-8226-f7ed6a4b03e1 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:37.887402 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-579f5306-f768-4600-bbbc-5e726b006918 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:37.906101 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-579f5306-f768-4600-bbbc-5e726b006918 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:37.911947 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-579f5306-f768-4600-bbbc-5e726b006918 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:37.915050 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-579f5306-f768-4600-bbbc-5e726b006918 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.446931 Jun 27 09:39:37.917679 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 239/456] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:37 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:37.931900 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f57748fb-4d62-426c-a67b-1244e147dbf0 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:37.934918 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-f57748fb-4d62-426c-a67b-1244e147dbf0 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:37.958743 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f57748fb-4d62-426c-a67b-1244e147dbf0 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:37.961800 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f57748fb-4d62-426c-a67b-1244e147dbf0 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:37.962944 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f57748fb-4d62-426c-a67b-1244e147dbf0 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:37.965785 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f57748fb-4d62-426c-a67b-1244e147dbf0 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:38.093518 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-6aef6d4d-9f4f-4984-8226-f7ed6a4b03e1 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:38.103064 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-6aef6d4d-9f4f-4984-8226-f7ed6a4b03e1 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 200 len: 1266 microversion: 2.1 time: 0.461946 Jun 27 09:39:38.130872 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 218/457] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:37 2022] GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 1266 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:38.142341 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-8f5bfb7d-7eea-46a3-93ad-5862a4ca2c4c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:38.142946 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-8f5bfb7d-7eea-46a3-93ad-5862a4ca2c4c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:38.189672 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8f5bfb7d-7eea-46a3-93ad-5862a4ca2c4c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:38.194557 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8f5bfb7d-7eea-46a3-93ad-5862a4ca2c4c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:38.194557 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8f5bfb7d-7eea-46a3-93ad-5862a4ca2c4c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:38.194557 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8f5bfb7d-7eea-46a3-93ad-5862a4ca2c4c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:38.517133 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f57748fb-4d62-426c-a67b-1244e147dbf0 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:38.526245 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-f57748fb-4d62-426c-a67b-1244e147dbf0 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1357 microversion: 2.1 time: 0.607412 Jun 27 09:39:38.532813 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 240/458] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:37 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1357 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:38.538148 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-3b2ff712-9161-4a74-99b8-1b496b26659f req-a74595f4-181a-4a3e-9593-1a516ab84016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d72055f-6915-43b5-9831-61c2f134e60a", "name": "network-vif-plugged", "status": "completed", "tag": "a233eb88-dce4-49a8-9bf9-7a59a86e981b"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:38.558875 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-3b2ff712-9161-4a74-99b8-1b496b26659f req-a74595f4-181a-4a3e-9593-1a516ab84016 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:38.563403 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-3b2ff712-9161-4a74-99b8-1b496b26659f req-a74595f4-181a-4a3e-9593-1a516ab84016 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:38.580416 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-3b2ff712-9161-4a74-99b8-1b496b26659f req-a74595f4-181a-4a3e-9593-1a516ab84016 service nova] Creating event network-vif-plugged:a233eb88-dce4-49a8-9bf9-7a59a86e981b for instance 1d72055f-6915-43b5-9831-61c2f134e60a on hv-cinder-84773 Jun 27 09:39:38.605336 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-3b2ff712-9161-4a74-99b8-1b496b26659f req-a74595f4-181a-4a3e-9593-1a516ab84016 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070543 Jun 27 09:39:38.606563 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 241/459] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:39:38.682997 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8f5bfb7d-7eea-46a3-93ad-5862a4ca2c4c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:38.689948 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=100 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:38.700526 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-8f5bfb7d-7eea-46a3-93ad-5862a4ca2c4c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1366 microversion: 2.1 time: 0.568449 Jun 27 09:39:38.701112 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 219/460] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:38 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1366 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:38.937109 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f8c6c671-4f66-4528-bbbc-2fd88be0bba4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:38.938913 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-f8c6c671-4f66-4528-bbbc-2fd88be0bba4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:38.949011 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f8c6c671-4f66-4528-bbbc-2fd88be0bba4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:38.954150 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f8c6c671-4f66-4528-bbbc-2fd88be0bba4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:38.956384 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f8c6c671-4f66-4528-bbbc-2fd88be0bba4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:38.957551 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f8c6c671-4f66-4528-bbbc-2fd88be0bba4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:39.133879 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-16488699-c4b0-44b4-b6df-7880c0235c8d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:39.134491 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-16488699-c4b0-44b4-b6df-7880c0235c8d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:39.150030 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-16488699-c4b0-44b4-b6df-7880c0235c8d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:39.150488 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-16488699-c4b0-44b4-b6df-7880c0235c8d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:39.151286 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-16488699-c4b0-44b4-b6df-7880c0235c8d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:39.158314 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-16488699-c4b0-44b4-b6df-7880c0235c8d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:39.464721 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f8c6c671-4f66-4528-bbbc-2fd88be0bba4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:39.480532 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f8c6c671-4f66-4528-bbbc-2fd88be0bba4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:39.486569 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f8c6c671-4f66-4528-bbbc-2fd88be0bba4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:39.488192 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-f8c6c671-4f66-4528-bbbc-2fd88be0bba4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.554104 Jun 27 09:39:39.497786 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-16488699-c4b0-44b4-b6df-7880c0235c8d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:39.502906 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-16488699-c4b0-44b4-b6df-7880c0235c8d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 200 len: 1272 microversion: 2.1 time: 0.373373 Jun 27 09:39:39.514136 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 242/461] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:38 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:39.548459 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 220/462] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:39 2022] GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 1272 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:39.550065 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-bfa95e8e-022f-4c97-8858-12c8f49955c1 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:39.550794 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-bfa95e8e-022f-4c97-8858-12c8f49955c1 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:39.580469 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-bfa95e8e-022f-4c97-8858-12c8f49955c1 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:39.581338 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-bfa95e8e-022f-4c97-8858-12c8f49955c1 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:39.584259 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-bfa95e8e-022f-4c97-8858-12c8f49955c1 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:39.586552 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-bfa95e8e-022f-4c97-8858-12c8f49955c1 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:39.721408 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-abdb583c-16f7-418d-a5fa-5ee2d6b0aeae tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:39.722918 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-abdb583c-16f7-418d-a5fa-5ee2d6b0aeae tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:39.739226 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-abdb583c-16f7-418d-a5fa-5ee2d6b0aeae tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:39.748875 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-abdb583c-16f7-418d-a5fa-5ee2d6b0aeae tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:39.748875 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-abdb583c-16f7-418d-a5fa-5ee2d6b0aeae tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:39.748875 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-abdb583c-16f7-418d-a5fa-5ee2d6b0aeae tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:40.127929 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-bfa95e8e-022f-4c97-8858-12c8f49955c1 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:40.140968 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-bfa95e8e-022f-4c97-8858-12c8f49955c1 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1357 microversion: 2.1 time: 0.595617 Jun 27 09:39:40.142444 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 243/463] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:39 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1357 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:40.148721 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-fcb16ad6-edeb-4207-bf09-e2fbce17145e req-50166476-bd82-4506-8eaa-79692de173eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "102adf3a-476d-4af7-8267-15e963425bde", "tag": "1c045054-5e3a-4e2b-8877-18f92b60b5a0"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:40.185454 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-fcb16ad6-edeb-4207-bf09-e2fbce17145e req-50166476-bd82-4506-8eaa-79692de173eb service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:40.189463 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-fcb16ad6-edeb-4207-bf09-e2fbce17145e req-50166476-bd82-4506-8eaa-79692de173eb service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:40.200537 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=100 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:40.225605 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-fcb16ad6-edeb-4207-bf09-e2fbce17145e req-50166476-bd82-4506-8eaa-79692de173eb service nova] Creating event network-changed:1c045054-5e3a-4e2b-8877-18f92b60b5a0 for instance 102adf3a-476d-4af7-8267-15e963425bde on hv-cinder-84773 Jun 27 09:39:40.242558 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-fcb16ad6-edeb-4207-bf09-e2fbce17145e req-50166476-bd82-4506-8eaa-79692de173eb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097909 Jun 27 09:39:40.243745 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 244/464] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:39:40.510705 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-bfd6edd7-367d-4cd8-a440-1c1adb442f0e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:40.512147 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-bfd6edd7-367d-4cd8-a440-1c1adb442f0e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:40.520258 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-bfd6edd7-367d-4cd8-a440-1c1adb442f0e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:40.521454 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-bfd6edd7-367d-4cd8-a440-1c1adb442f0e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:40.521454 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-bfd6edd7-367d-4cd8-a440-1c1adb442f0e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:40.522000 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-bfd6edd7-367d-4cd8-a440-1c1adb442f0e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:40.826602 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-bfd6edd7-367d-4cd8-a440-1c1adb442f0e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:40.829973 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-abdb583c-16f7-418d-a5fa-5ee2d6b0aeae tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:40.841910 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-bfd6edd7-367d-4cd8-a440-1c1adb442f0e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:40.843747 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-bfd6edd7-367d-4cd8-a440-1c1adb442f0e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:40.848594 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-abdb583c-16f7-418d-a5fa-5ee2d6b0aeae tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1366 microversion: 2.1 time: 1.133436 Jun 27 09:39:40.849523 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 221/465] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:39 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1366 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:40.852159 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-bfd6edd7-367d-4cd8-a440-1c1adb442f0e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.346063 Jun 27 09:39:40.856183 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-ab0295e7-ae4f-40b6-b8a7-a526ff2d139f tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:40.857436 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 245/466] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:40 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:40.857644 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-ab0295e7-ae4f-40b6-b8a7-a526ff2d139f tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:40.864219 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ab0295e7-ae4f-40b6-b8a7-a526ff2d139f tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:40.865064 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ab0295e7-ae4f-40b6-b8a7-a526ff2d139f tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:40.866290 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ab0295e7-ae4f-40b6-b8a7-a526ff2d139f tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:40.866948 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ab0295e7-ae4f-40b6-b8a7-a526ff2d139f tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:41.135466 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-ab0295e7-ae4f-40b6-b8a7-a526ff2d139f tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:41.144378 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-ab0295e7-ae4f-40b6-b8a7-a526ff2d139f tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 200 len: 1314 microversion: 2.1 time: 0.293238 Jun 27 09:39:41.158584 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-c45d8cfd-d6da-4234-a24a-88d40d3c8e63 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:41.159259 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-c45d8cfd-d6da-4234-a24a-88d40d3c8e63 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:41.160380 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 222/467] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:40 2022] GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:41.177580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c45d8cfd-d6da-4234-a24a-88d40d3c8e63 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:41.178037 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c45d8cfd-d6da-4234-a24a-88d40d3c8e63 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:41.178868 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c45d8cfd-d6da-4234-a24a-88d40d3c8e63 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:41.179924 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c45d8cfd-d6da-4234-a24a-88d40d3c8e63 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:41.515104 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-c45d8cfd-d6da-4234-a24a-88d40d3c8e63 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:41.537758 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-c45d8cfd-d6da-4234-a24a-88d40d3c8e63 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1357 microversion: 2.1 time: 0.383398 Jun 27 09:39:41.539210 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 246/468] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:41 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1357 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:41.868557 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-eefeb240-93a2-4943-9835-593a3b2b83b1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:41.868557 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-eefeb240-93a2-4943-9835-593a3b2b83b1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:41.881143 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e3a79c01-f628-42ea-a9a9-5a905986182e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:41.882265 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-e3a79c01-f628-42ea-a9a9-5a905986182e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:41.885418 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-eefeb240-93a2-4943-9835-593a3b2b83b1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:41.887456 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-eefeb240-93a2-4943-9835-593a3b2b83b1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:41.892823 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-eefeb240-93a2-4943-9835-593a3b2b83b1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:41.895712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-eefeb240-93a2-4943-9835-593a3b2b83b1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:41.917909 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e3a79c01-f628-42ea-a9a9-5a905986182e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:41.918640 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e3a79c01-f628-42ea-a9a9-5a905986182e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:41.921050 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e3a79c01-f628-42ea-a9a9-5a905986182e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:41.922064 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e3a79c01-f628-42ea-a9a9-5a905986182e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:42.221874 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-eefeb240-93a2-4943-9835-593a3b2b83b1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:42.230643 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-eefeb240-93a2-4943-9835-593a3b2b83b1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1366 microversion: 2.1 time: 0.369028 Jun 27 09:39:42.231387 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 223/469] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:41 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1366 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:42.237501 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-58282d68-ee65-44de-8097-45eff7abf9ee tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:42.240746 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-58282d68-ee65-44de-8097-45eff7abf9ee tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:42.244560 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e3a79c01-f628-42ea-a9a9-5a905986182e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:42.245096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-58282d68-ee65-44de-8097-45eff7abf9ee tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:42.245511 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-58282d68-ee65-44de-8097-45eff7abf9ee tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:42.246298 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-58282d68-ee65-44de-8097-45eff7abf9ee tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:42.246738 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-58282d68-ee65-44de-8097-45eff7abf9ee tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:42.255029 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e3a79c01-f628-42ea-a9a9-5a905986182e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:42.256926 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e3a79c01-f628-42ea-a9a9-5a905986182e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:42.259286 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-e3a79c01-f628-42ea-a9a9-5a905986182e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.384176 Jun 27 09:39:42.260175 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 247/470] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:41 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:42.398647 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-58282d68-ee65-44de-8097-45eff7abf9ee tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:42.406237 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-58282d68-ee65-44de-8097-45eff7abf9ee tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 200 len: 1314 microversion: 2.1 time: 0.173371 Jun 27 09:39:42.411796 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 224/471] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:42 2022] GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:42.482413 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-0bdcdbe7-6520-4e57-858a-b9e4c0eacbd9 req-93ae02e2-4c47-4e44-bcee-936b17e5b3fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e660d346-4a6c-4328-b2ab-34f3c8d2af0f", "tag": "d9ff1e9e-ad49-4446-85dc-750360ad4de7"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:42.490521 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-0bdcdbe7-6520-4e57-858a-b9e4c0eacbd9 req-93ae02e2-4c47-4e44-bcee-936b17e5b3fb service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:42.490973 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-0bdcdbe7-6520-4e57-858a-b9e4c0eacbd9 req-93ae02e2-4c47-4e44-bcee-936b17e5b3fb service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:42.503582 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-0bdcdbe7-6520-4e57-858a-b9e4c0eacbd9 req-93ae02e2-4c47-4e44-bcee-936b17e5b3fb service nova] Creating event network-changed:d9ff1e9e-ad49-4446-85dc-750360ad4de7 for instance e660d346-4a6c-4328-b2ab-34f3c8d2af0f on hv-cinder-84773 Jun 27 09:39:42.508975 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-0bdcdbe7-6520-4e57-858a-b9e4c0eacbd9 req-93ae02e2-4c47-4e44-bcee-936b17e5b3fb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030268 Jun 27 09:39:42.509533 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 248/472] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:39:42.554117 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-fa88139a-a49e-49f9-a9c6-b60c72733311 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:42.555218 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-fa88139a-a49e-49f9-a9c6-b60c72733311 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:42.561179 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fa88139a-a49e-49f9-a9c6-b60c72733311 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:42.561608 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fa88139a-a49e-49f9-a9c6-b60c72733311 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:42.562361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fa88139a-a49e-49f9-a9c6-b60c72733311 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:42.562793 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fa88139a-a49e-49f9-a9c6-b60c72733311 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:42.757124 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-fa88139a-a49e-49f9-a9c6-b60c72733311 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:42.757124 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-fa88139a-a49e-49f9-a9c6-b60c72733311 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1357 microversion: 2.1 time: 0.180936 Jun 27 09:39:42.757124 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 225/473] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:42 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:43.247984 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-ebbbe5ef-94c5-49fa-934e-f74b5a44fd84 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:43.248683 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-ebbbe5ef-94c5-49fa-934e-f74b5a44fd84 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:43.255330 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ebbbe5ef-94c5-49fa-934e-f74b5a44fd84 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:43.255859 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ebbbe5ef-94c5-49fa-934e-f74b5a44fd84 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:43.256577 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ebbbe5ef-94c5-49fa-934e-f74b5a44fd84 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:43.257086 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ebbbe5ef-94c5-49fa-934e-f74b5a44fd84 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:43.280725 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-33b6a9e4-9cec-4b5d-bec4-7d0b1209357a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:43.281458 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-33b6a9e4-9cec-4b5d-bec4-7d0b1209357a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:43.283658 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=2 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:43.296288 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-33b6a9e4-9cec-4b5d-bec4-7d0b1209357a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:43.296760 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-33b6a9e4-9cec-4b5d-bec4-7d0b1209357a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:43.297746 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-33b6a9e4-9cec-4b5d-bec4-7d0b1209357a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:43.298291 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-33b6a9e4-9cec-4b5d-bec4-7d0b1209357a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:43.408918 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-ebbbe5ef-94c5-49fa-934e-f74b5a44fd84 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:43.416797 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-ebbbe5ef-94c5-49fa-934e-f74b5a44fd84 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1366 microversion: 2.1 time: 0.172957 Jun 27 09:39:43.417364 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 249/474] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:43 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:43.430121 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-a4f60880-8572-4afa-95a4-e959735192f1 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:43.430992 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-a4f60880-8572-4afa-95a4-e959735192f1 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:43.439515 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a4f60880-8572-4afa-95a4-e959735192f1 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:43.440207 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a4f60880-8572-4afa-95a4-e959735192f1 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:43.441048 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a4f60880-8572-4afa-95a4-e959735192f1 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:43.441454 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a4f60880-8572-4afa-95a4-e959735192f1 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:43.445550 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-33b6a9e4-9cec-4b5d-bec4-7d0b1209357a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:43.454468 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-33b6a9e4-9cec-4b5d-bec4-7d0b1209357a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:43.455999 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-33b6a9e4-9cec-4b5d-bec4-7d0b1209357a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:43.457161 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-33b6a9e4-9cec-4b5d-bec4-7d0b1209357a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.180874 Jun 27 09:39:43.457710 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 226/475] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:43 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:43.575157 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-a4f60880-8572-4afa-95a4-e959735192f1 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:43.582863 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-a4f60880-8572-4afa-95a4-e959735192f1 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 200 len: 1314 microversion: 2.1 time: 0.157144 Jun 27 09:39:43.583425 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 250/476] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:43 2022] GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:43.748372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-0d48aaa6-d8c2-4f41-a581-78f32dfb2c27 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:43.748975 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-0d48aaa6-d8c2-4f41-a581-78f32dfb2c27 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:43.755206 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0d48aaa6-d8c2-4f41-a581-78f32dfb2c27 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:43.755511 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0d48aaa6-d8c2-4f41-a581-78f32dfb2c27 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:43.756298 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0d48aaa6-d8c2-4f41-a581-78f32dfb2c27 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:43.756728 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0d48aaa6-d8c2-4f41-a581-78f32dfb2c27 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:43.775614 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=8 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:43.884591 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-0d48aaa6-d8c2-4f41-a581-78f32dfb2c27 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:43.891828 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-0d48aaa6-d8c2-4f41-a581-78f32dfb2c27 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1357 microversion: 2.1 time: 0.147265 Jun 27 09:39:43.892379 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 227/477] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:43 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:44.433637 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-22fe4a4c-dc44-40c2-af8f-6d4a1380d09d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:44.434372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-22fe4a4c-dc44-40c2-af8f-6d4a1380d09d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:44.440867 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-22fe4a4c-dc44-40c2-af8f-6d4a1380d09d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:44.441323 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-22fe4a4c-dc44-40c2-af8f-6d4a1380d09d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:44.442085 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-22fe4a4c-dc44-40c2-af8f-6d4a1380d09d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:44.442519 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-22fe4a4c-dc44-40c2-af8f-6d4a1380d09d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:44.475696 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-44270cdd-0f49-4b53-99d9-241c6f9835b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:44.476313 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-44270cdd-0f49-4b53-99d9-241c6f9835b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:44.486410 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-44270cdd-0f49-4b53-99d9-241c6f9835b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:44.486845 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-44270cdd-0f49-4b53-99d9-241c6f9835b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:44.487688 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-44270cdd-0f49-4b53-99d9-241c6f9835b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:44.488138 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-44270cdd-0f49-4b53-99d9-241c6f9835b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:44.708661 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-44270cdd-0f49-4b53-99d9-241c6f9835b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:44.718405 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-44270cdd-0f49-4b53-99d9-241c6f9835b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:44.720411 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-44270cdd-0f49-4b53-99d9-241c6f9835b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:44.721755 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-44270cdd-0f49-4b53-99d9-241c6f9835b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.249906 Jun 27 09:39:44.722361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 228/478] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:44 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:39:44.727553 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-892f9d10-4cf9-4068-a10b-ae48098b5449 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:44.728144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-892f9d10-4cf9-4068-a10b-ae48098b5449 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:44.734852 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-892f9d10-4cf9-4068-a10b-ae48098b5449 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:44.735354 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-892f9d10-4cf9-4068-a10b-ae48098b5449 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:44.745548 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-892f9d10-4cf9-4068-a10b-ae48098b5449 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:44.745548 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-892f9d10-4cf9-4068-a10b-ae48098b5449 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:44.871716 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-22fe4a4c-dc44-40c2-af8f-6d4a1380d09d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:44.879463 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-22fe4a4c-dc44-40c2-af8f-6d4a1380d09d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1366 microversion: 2.1 time: 0.449678 Jun 27 09:39:44.880077 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 251/479] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:44 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1366 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:44.900582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-892f9d10-4cf9-4068-a10b-ae48098b5449 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:44.908620 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f9ffd21e-fb6c-4be2-a6e0-9ad7eed19c2a tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:44.908825 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-892f9d10-4cf9-4068-a10b-ae48098b5449 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 200 len: 1314 microversion: 2.1 time: 0.185324 Jun 27 09:39:44.909310 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 229/480] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:44 2022] GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:44.909448 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-f9ffd21e-fb6c-4be2-a6e0-9ad7eed19c2a tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:44.916920 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f9ffd21e-fb6c-4be2-a6e0-9ad7eed19c2a tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:44.917436 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f9ffd21e-fb6c-4be2-a6e0-9ad7eed19c2a tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:44.918272 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f9ffd21e-fb6c-4be2-a6e0-9ad7eed19c2a tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:44.918778 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f9ffd21e-fb6c-4be2-a6e0-9ad7eed19c2a tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:45.053397 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f9ffd21e-fb6c-4be2-a6e0-9ad7eed19c2a tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:45.061000 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-f9ffd21e-fb6c-4be2-a6e0-9ad7eed19c2a tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1357 microversion: 2.1 time: 0.156252 Jun 27 09:39:45.061567 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 252/481] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:44 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:45.739956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-48432de6-435a-4a43-8bda-ecd838724bfb tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:45.740581 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-48432de6-435a-4a43-8bda-ecd838724bfb tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:45.749700 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-48432de6-435a-4a43-8bda-ecd838724bfb tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:45.750954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-48432de6-435a-4a43-8bda-ecd838724bfb tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:45.752470 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-48432de6-435a-4a43-8bda-ecd838724bfb tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:45.753072 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-48432de6-435a-4a43-8bda-ecd838724bfb tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:45.897195 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-2907237a-342e-42d8-b198-34cd524221ba tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:45.897824 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-2907237a-342e-42d8-b198-34cd524221ba tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:45.908768 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2907237a-342e-42d8-b198-34cd524221ba tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:45.912165 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2907237a-342e-42d8-b198-34cd524221ba tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:45.915508 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2907237a-342e-42d8-b198-34cd524221ba tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:45.916445 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2907237a-342e-42d8-b198-34cd524221ba tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:45.959672 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-48432de6-435a-4a43-8bda-ecd838724bfb tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:45.971290 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-48432de6-435a-4a43-8bda-ecd838724bfb tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:45.973334 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-48432de6-435a-4a43-8bda-ecd838724bfb tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:45.974795 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-48432de6-435a-4a43-8bda-ecd838724bfb tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1808 microversion: 2.20 time: 0.238859 Jun 27 09:39:45.987647 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 230/482] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:45 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:45.994056 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-2d99f839-485e-4d23-9aaa-7bf5c270ec1c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:45.994746 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-2d99f839-485e-4d23-9aaa-7bf5c270ec1c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:46.001953 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2d99f839-485e-4d23-9aaa-7bf5c270ec1c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:46.002663 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2d99f839-485e-4d23-9aaa-7bf5c270ec1c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:46.003451 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2d99f839-485e-4d23-9aaa-7bf5c270ec1c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:46.003921 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2d99f839-485e-4d23-9aaa-7bf5c270ec1c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:46.188921 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-2d99f839-485e-4d23-9aaa-7bf5c270ec1c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:46.199963 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-2d99f839-485e-4d23-9aaa-7bf5c270ec1c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 200 len: 1314 microversion: 2.1 time: 0.210747 Jun 27 09:39:46.201156 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 231/483] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:45 2022] GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:46.218300 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a463fb78-93ba-4725-9250-06c95d44a963 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:46.219072 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-a463fb78-93ba-4725-9250-06c95d44a963 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:46.227550 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a463fb78-93ba-4725-9250-06c95d44a963 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:46.228148 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a463fb78-93ba-4725-9250-06c95d44a963 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:46.229152 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a463fb78-93ba-4725-9250-06c95d44a963 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:46.229704 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a463fb78-93ba-4725-9250-06c95d44a963 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:46.241153 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2907237a-342e-42d8-b198-34cd524221ba tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:46.252698 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-2907237a-342e-42d8-b198-34cd524221ba tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1366 microversion: 2.1 time: 0.359190 Jun 27 09:39:46.253785 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 253/484] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:45 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1366 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:46.401276 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a463fb78-93ba-4725-9250-06c95d44a963 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:46.408753 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-a463fb78-93ba-4725-9250-06c95d44a963 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1357 microversion: 2.1 time: 0.203990 Jun 27 09:39:46.409344 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 232/485] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:46 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1357 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:46.994067 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-aab497d2-0e47-4c17-9175-1e778b9bec41 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:46.994681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-aab497d2-0e47-4c17-9175-1e778b9bec41 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:47.000057 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell0:SELECT=20 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:47.002227 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-aab497d2-0e47-4c17-9175-1e778b9bec41 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:47.002844 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-aab497d2-0e47-4c17-9175-1e778b9bec41 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:47.003654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-aab497d2-0e47-4c17-9175-1e778b9bec41 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:47.004096 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-aab497d2-0e47-4c17-9175-1e778b9bec41 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:47.142152 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-aab497d2-0e47-4c17-9175-1e778b9bec41 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:47.149006 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-aab497d2-0e47-4c17-9175-1e778b9bec41 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:47.150595 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-aab497d2-0e47-4c17-9175-1e778b9bec41 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:47.151848 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-aab497d2-0e47-4c17-9175-1e778b9bec41 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1795 microversion: 2.20 time: 0.161573 Jun 27 09:39:47.152402 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 254/486] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:39:46 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1795 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:39:47.217382 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a5f3c228-b201-432f-bc7f-2a889dbdd285 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:47.217933 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-a5f3c228-b201-432f-bc7f-2a889dbdd285 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:47.224668 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a5f3c228-b201-432f-bc7f-2a889dbdd285 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:47.225113 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a5f3c228-b201-432f-bc7f-2a889dbdd285 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:47.225925 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a5f3c228-b201-432f-bc7f-2a889dbdd285 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:47.226365 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a5f3c228-b201-432f-bc7f-2a889dbdd285 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:47.270738 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-9295e7df-282a-4f10-ba33-74d491c0881c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:47.271507 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-9295e7df-282a-4f10-ba33-74d491c0881c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:47.307370 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9295e7df-282a-4f10-ba33-74d491c0881c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:47.307370 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9295e7df-282a-4f10-ba33-74d491c0881c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:47.307370 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9295e7df-282a-4f10-ba33-74d491c0881c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:47.307370 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9295e7df-282a-4f10-ba33-74d491c0881c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:47.373314 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a5f3c228-b201-432f-bc7f-2a889dbdd285 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:47.381574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-a5f3c228-b201-432f-bc7f-2a889dbdd285 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 200 len: 1314 microversion: 2.1 time: 0.168127 Jun 27 09:39:47.382917 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 233/487] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:47 2022] GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:47.430423 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-fade0aab-7b95-47e4-9fd6-1ae2009eede8 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:47.431074 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-fade0aab-7b95-47e4-9fd6-1ae2009eede8 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:47.433266 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-9295e7df-282a-4f10-ba33-74d491c0881c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:47.439163 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fade0aab-7b95-47e4-9fd6-1ae2009eede8 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:47.439703 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fade0aab-7b95-47e4-9fd6-1ae2009eede8 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:47.440638 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fade0aab-7b95-47e4-9fd6-1ae2009eede8 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:47.441167 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fade0aab-7b95-47e4-9fd6-1ae2009eede8 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:47.442039 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-9295e7df-282a-4f10-ba33-74d491c0881c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1366 microversion: 2.1 time: 0.175774 Jun 27 09:39:47.442622 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 255/488] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:47 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:47.590177 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-fade0aab-7b95-47e4-9fd6-1ae2009eede8 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:47.597822 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-fade0aab-7b95-47e4-9fd6-1ae2009eede8 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1357 microversion: 2.1 time: 0.175470 Jun 27 09:39:47.598514 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 234/489] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:47 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:48.400591 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-a8ffaf12-f341-428d-99d2-dd8c1e033a62 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:48.401195 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-a8ffaf12-f341-428d-99d2-dd8c1e033a62 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:48.408014 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a8ffaf12-f341-428d-99d2-dd8c1e033a62 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:48.408461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a8ffaf12-f341-428d-99d2-dd8c1e033a62 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:48.409235 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a8ffaf12-f341-428d-99d2-dd8c1e033a62 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:48.409668 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a8ffaf12-f341-428d-99d2-dd8c1e033a62 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:48.458421 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-04bb5d6c-7248-4b27-b9f2-8afe69faa3e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:48.459210 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-04bb5d6c-7248-4b27-b9f2-8afe69faa3e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:48.466716 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-04bb5d6c-7248-4b27-b9f2-8afe69faa3e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:48.467164 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-04bb5d6c-7248-4b27-b9f2-8afe69faa3e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:48.467979 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-04bb5d6c-7248-4b27-b9f2-8afe69faa3e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:48.468416 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-04bb5d6c-7248-4b27-b9f2-8afe69faa3e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:48.552439 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-a8ffaf12-f341-428d-99d2-dd8c1e033a62 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:48.561676 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-a8ffaf12-f341-428d-99d2-dd8c1e033a62 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 200 len: 1314 microversion: 2.1 time: 0.165458 Jun 27 09:39:48.562449 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 256/490] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:48 2022] GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:48.594641 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-24298587-d2e7-4aa4-8b2b-7dcfea68917e req-927d887f-75cb-4dda-9d88-a1947f268c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129", "name": "network-vif-plugged", "status": "completed", "tag": "b7d364ab-ebca-4312-8213-6c5cc722e7bc"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:48.612135 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-24298587-d2e7-4aa4-8b2b-7dcfea68917e req-927d887f-75cb-4dda-9d88-a1947f268c7c service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:48.612586 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-24298587-d2e7-4aa4-8b2b-7dcfea68917e req-927d887f-75cb-4dda-9d88-a1947f268c7c service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:48.623488 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-04bb5d6c-7248-4b27-b9f2-8afe69faa3e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:48.625164 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-24298587-d2e7-4aa4-8b2b-7dcfea68917e req-927d887f-75cb-4dda-9d88-a1947f268c7c service nova] Creating event network-vif-plugged:b7d364ab-ebca-4312-8213-6c5cc722e7bc for instance b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 on hv-cinder-84773 Jun 27 09:39:48.630224 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-24298587-d2e7-4aa4-8b2b-7dcfea68917e req-927d887f-75cb-4dda-9d88-a1947f268c7c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039399 Jun 27 09:39:48.630989 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 257/491] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:39:48.633667 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-04bb5d6c-7248-4b27-b9f2-8afe69faa3e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1366 microversion: 2.1 time: 0.176669 Jun 27 09:39:48.633667 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 235/492] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:48 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:48.636934 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-42dec79f-dd28-4735-be68-5d6faf8d2273 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:48.637627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-42dec79f-dd28-4735-be68-5d6faf8d2273 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:48.653761 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-42dec79f-dd28-4735-be68-5d6faf8d2273 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:48.654213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-42dec79f-dd28-4735-be68-5d6faf8d2273 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:48.654993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-42dec79f-dd28-4735-be68-5d6faf8d2273 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:48.655581 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-42dec79f-dd28-4735-be68-5d6faf8d2273 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:48.799173 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-42dec79f-dd28-4735-be68-5d6faf8d2273 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:48.810468 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-42dec79f-dd28-4735-be68-5d6faf8d2273 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1357 microversion: 2.1 time: 0.175879 Jun 27 09:39:48.810468 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 258/493] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:48 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:49.578539 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-f13a1830-792f-4811-ad31-fd09835367ba tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:49.579154 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-f13a1830-792f-4811-ad31-fd09835367ba tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:49.585972 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f13a1830-792f-4811-ad31-fd09835367ba tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:49.586420 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f13a1830-792f-4811-ad31-fd09835367ba tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:49.587178 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f13a1830-792f-4811-ad31-fd09835367ba tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:49.587648 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f13a1830-792f-4811-ad31-fd09835367ba tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:49.607416 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=100 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:49.649067 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-0b9c8a89-389b-4fec-a612-ce76293a1713 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:49.649681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-0b9c8a89-389b-4fec-a612-ce76293a1713 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:49.656212 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0b9c8a89-389b-4fec-a612-ce76293a1713 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:49.656662 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0b9c8a89-389b-4fec-a612-ce76293a1713 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:49.657424 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0b9c8a89-389b-4fec-a612-ce76293a1713 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:49.657857 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0b9c8a89-389b-4fec-a612-ce76293a1713 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:49.723726 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-f13a1830-792f-4811-ad31-fd09835367ba tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:49.731210 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-f13a1830-792f-4811-ad31-fd09835367ba tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 200 len: 1314 microversion: 2.1 time: 0.156808 Jun 27 09:39:49.731812 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 236/494] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:49 2022] GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:49.787800 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-0b9c8a89-389b-4fec-a612-ce76293a1713 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:49.795709 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-0b9c8a89-389b-4fec-a612-ce76293a1713 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1366 microversion: 2.1 time: 0.150901 Jun 27 09:39:49.796304 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 259/495] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:49 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:49.825421 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-14dc92ed-844e-400e-b857-afdfbcc3f046 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:49.826064 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-14dc92ed-844e-400e-b857-afdfbcc3f046 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:49.832047 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-14dc92ed-844e-400e-b857-afdfbcc3f046 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:49.832492 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-14dc92ed-844e-400e-b857-afdfbcc3f046 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:49.833248 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-14dc92ed-844e-400e-b857-afdfbcc3f046 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:49.833688 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-14dc92ed-844e-400e-b857-afdfbcc3f046 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:49.962736 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-14dc92ed-844e-400e-b857-afdfbcc3f046 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:49.970052 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-14dc92ed-844e-400e-b857-afdfbcc3f046 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1357 microversion: 2.1 time: 0.148455 Jun 27 09:39:49.970603 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 237/496] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:49 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:50.748373 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-8a0903e9-d109-48bc-9cdd-f3f0ea48e5ae tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:50.748981 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-8a0903e9-d109-48bc-9cdd-f3f0ea48e5ae tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:50.755424 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8a0903e9-d109-48bc-9cdd-f3f0ea48e5ae tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:50.755902 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8a0903e9-d109-48bc-9cdd-f3f0ea48e5ae tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:50.756681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8a0903e9-d109-48bc-9cdd-f3f0ea48e5ae tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:50.757171 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8a0903e9-d109-48bc-9cdd-f3f0ea48e5ae tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:50.812718 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-0ead1976-e34d-4b73-92dd-fc96304235ec tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:50.813332 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-0ead1976-e34d-4b73-92dd-fc96304235ec tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:50.819830 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0ead1976-e34d-4b73-92dd-fc96304235ec tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:50.820283 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0ead1976-e34d-4b73-92dd-fc96304235ec tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:50.821057 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0ead1976-e34d-4b73-92dd-fc96304235ec tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:50.821496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0ead1976-e34d-4b73-92dd-fc96304235ec tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:50.896006 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-8a0903e9-d109-48bc-9cdd-f3f0ea48e5ae tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:50.904300 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-8a0903e9-d109-48bc-9cdd-f3f0ea48e5ae tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 200 len: 1314 microversion: 2.1 time: 0.159717 Jun 27 09:39:50.904866 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 260/497] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:50 2022] GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:50.962649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-0ead1976-e34d-4b73-92dd-fc96304235ec tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:50.970081 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-0ead1976-e34d-4b73-92dd-fc96304235ec tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1366 microversion: 2.1 time: 0.161235 Jun 27 09:39:50.970637 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 238/498] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:50 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:50.986069 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-b428d141-e17e-43ab-9acb-5ada8daaba20 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:50.986677 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-b428d141-e17e-43ab-9acb-5ada8daaba20 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:50.993068 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b428d141-e17e-43ab-9acb-5ada8daaba20 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:50.993513 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b428d141-e17e-43ab-9acb-5ada8daaba20 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:50.994277 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b428d141-e17e-43ab-9acb-5ada8daaba20 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:50.994712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b428d141-e17e-43ab-9acb-5ada8daaba20 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:51.136788 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-b428d141-e17e-43ab-9acb-5ada8daaba20 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:51.144303 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-b428d141-e17e-43ab-9acb-5ada8daaba20 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1357 microversion: 2.1 time: 0.162110 Jun 27 09:39:51.144868 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 261/499] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:50 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:51.308318 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-91b19100-e88f-4742-8bf0-c5bbf01438a0 req-a27c744b-17d8-40f3-94bd-10b07ecccc44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "102adf3a-476d-4af7-8267-15e963425bde", "name": "network-vif-plugged", "status": "completed", "tag": "1c045054-5e3a-4e2b-8877-18f92b60b5a0"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:51.316438 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-91b19100-e88f-4742-8bf0-c5bbf01438a0 req-a27c744b-17d8-40f3-94bd-10b07ecccc44 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:51.316878 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-91b19100-e88f-4742-8bf0-c5bbf01438a0 req-a27c744b-17d8-40f3-94bd-10b07ecccc44 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:51.328359 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-91b19100-e88f-4742-8bf0-c5bbf01438a0 req-a27c744b-17d8-40f3-94bd-10b07ecccc44 service nova] Creating event network-vif-plugged:1c045054-5e3a-4e2b-8877-18f92b60b5a0 for instance 102adf3a-476d-4af7-8267-15e963425bde on hv-cinder-84773 Jun 27 09:39:51.337114 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-91b19100-e88f-4742-8bf0-c5bbf01438a0 req-a27c744b-17d8-40f3-94bd-10b07ecccc44 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032441 Jun 27 09:39:51.337894 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 239/500] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:39:51.922043 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-d48bedf2-ef76-4697-9724-e7e9c5aee196 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:51.922572 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-d48bedf2-ef76-4697-9724-e7e9c5aee196 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:51.929617 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d48bedf2-ef76-4697-9724-e7e9c5aee196 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:51.930062 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d48bedf2-ef76-4697-9724-e7e9c5aee196 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:51.930815 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d48bedf2-ef76-4697-9724-e7e9c5aee196 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:51.931252 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d48bedf2-ef76-4697-9724-e7e9c5aee196 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:51.988335 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-98a458d1-7f87-426d-a4f3-5be6d5026328 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:51.989032 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-98a458d1-7f87-426d-a4f3-5be6d5026328 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:51.995735 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-98a458d1-7f87-426d-a4f3-5be6d5026328 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:51.996185 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-98a458d1-7f87-426d-a4f3-5be6d5026328 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:51.996947 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-98a458d1-7f87-426d-a4f3-5be6d5026328 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:51.997383 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-98a458d1-7f87-426d-a4f3-5be6d5026328 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:52.062718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-d48bedf2-ef76-4697-9724-e7e9c5aee196 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:52.065103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=100 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:52.071183 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-d48bedf2-ef76-4697-9724-e7e9c5aee196 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 200 len: 1314 microversion: 2.1 time: 0.153021 Jun 27 09:39:52.071843 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 262/501] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:51 2022] GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:52.138320 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-98a458d1-7f87-426d-a4f3-5be6d5026328 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:52.145686 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-98a458d1-7f87-426d-a4f3-5be6d5026328 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1366 microversion: 2.1 time: 0.162037 Jun 27 09:39:52.146237 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 240/502] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:51 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:52.161518 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-370df656-e660-44a2-af1c-d6b875889910 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:52.162133 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-370df656-e660-44a2-af1c-d6b875889910 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:52.169329 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-370df656-e660-44a2-af1c-d6b875889910 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:52.169782 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-370df656-e660-44a2-af1c-d6b875889910 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:52.170546 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-370df656-e660-44a2-af1c-d6b875889910 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:52.170985 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-370df656-e660-44a2-af1c-d6b875889910 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:52.305514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-370df656-e660-44a2-af1c-d6b875889910 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:52.313020 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-370df656-e660-44a2-af1c-d6b875889910 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1547 microversion: 2.1 time: 0.155440 Jun 27 09:39:52.313567 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 263/503] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:52 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:52.329384 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-195825db-ef95-4a52-87cf-086c984b559c tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:52.329990 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-195825db-ef95-4a52-87cf-086c984b559c tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:52.336723 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-195825db-ef95-4a52-87cf-086c984b559c tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:52.337175 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-195825db-ef95-4a52-87cf-086c984b559c tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:52.337938 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-195825db-ef95-4a52-87cf-086c984b559c tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:52.338377 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-195825db-ef95-4a52-87cf-086c984b559c tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:52.466220 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-195825db-ef95-4a52-87cf-086c984b559c tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:52.473473 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-195825db-ef95-4a52-87cf-086c984b559c tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1547 microversion: 2.1 time: 0.147954 Jun 27 09:39:52.474021 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 241/504] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:52 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:52.489411 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-4cb8b06c-ce71-4525-a4a6-f0db890bea1c tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:52.493216 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4cb8b06c-ce71-4525-a4a6-f0db890bea1c tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:52.493997 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-4cb8b06c-ce71-4525-a4a6-f0db890bea1c tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Searching by: {'deleted': False, 'project_id': '55f89ed92a124e2c8a274975bc0935ba'} {{(pid=124869) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 27 09:39:52.500677 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4cb8b06c-ce71-4525-a4a6-f0db890bea1c tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:52.501119 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4cb8b06c-ce71-4525-a4a6-f0db890bea1c tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:52.501897 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4cb8b06c-ce71-4525-a4a6-f0db890bea1c tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:52.502324 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4cb8b06c-ce71-4525-a4a6-f0db890bea1c tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:52.590682 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.multi_cell_list [None req-4cb8b06c-ce71-4525-a4a6-f0db890bea1c tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 27 09:39:52.684521 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-4cb8b06c-ce71-4525-a4a6-f0db890bea1c tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.198908 Jun 27 09:39:52.685094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 264/505] 10.222.0.64 () {58 vars in 1124 bytes} [Mon Jun 27 09:39:52 2022] GET /compute/v2.1/servers => generated 342 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:39:52.695560 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a2ebb005-e9e3-4a7a-a68c-23808a63d718 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:52.696174 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-a2ebb005-e9e3-4a7a-a68c-23808a63d718 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:52.702210 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a2ebb005-e9e3-4a7a-a68c-23808a63d718 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:52.702664 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a2ebb005-e9e3-4a7a-a68c-23808a63d718 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:52.703426 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a2ebb005-e9e3-4a7a-a68c-23808a63d718 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:52.703891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a2ebb005-e9e3-4a7a-a68c-23808a63d718 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:52.835129 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a2ebb005-e9e3-4a7a-a68c-23808a63d718 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:52.843110 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-a2ebb005-e9e3-4a7a-a68c-23808a63d718 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1547 microversion: 2.1 time: 0.151826 Jun 27 09:39:52.843701 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 242/506] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:52 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:53.088708 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-5ca5934a-ef6e-43fa-ae98-866063fdcf49 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:53.089246 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-5ca5934a-ef6e-43fa-ae98-866063fdcf49 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:53.096259 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5ca5934a-ef6e-43fa-ae98-866063fdcf49 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:53.096514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5ca5934a-ef6e-43fa-ae98-866063fdcf49 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:53.097285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5ca5934a-ef6e-43fa-ae98-866063fdcf49 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:53.097724 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5ca5934a-ef6e-43fa-ae98-866063fdcf49 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:53.162027 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-763b7b40-bd04-41dd-8496-ad3a84238565 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:53.162791 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-763b7b40-bd04-41dd-8496-ad3a84238565 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:53.169583 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-763b7b40-bd04-41dd-8496-ad3a84238565 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:53.170030 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-763b7b40-bd04-41dd-8496-ad3a84238565 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:53.170782 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-763b7b40-bd04-41dd-8496-ad3a84238565 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:53.171606 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-763b7b40-bd04-41dd-8496-ad3a84238565 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:53.240638 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-5ca5934a-ef6e-43fa-ae98-866063fdcf49 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:53.249439 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-5ca5934a-ef6e-43fa-ae98-866063fdcf49 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 200 len: 1314 microversion: 2.1 time: 0.164713 Jun 27 09:39:53.252147 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 265/507] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:53 2022] GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:53.339084 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-763b7b40-bd04-41dd-8496-ad3a84238565 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:53.346601 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-763b7b40-bd04-41dd-8496-ad3a84238565 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1366 microversion: 2.1 time: 0.188330 Jun 27 09:39:53.347164 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 243/508] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:53 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:53.352158 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-32fb940b-a4d9-4861-b106-6bb84c7d832e req-582d2ab8-2d8b-4e68-9c67-eabc7f247389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e660d346-4a6c-4328-b2ab-34f3c8d2af0f", "name": "network-vif-plugged", "status": "completed", "tag": "d9ff1e9e-ad49-4446-85dc-750360ad4de7"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:53.360337 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-32fb940b-a4d9-4861-b106-6bb84c7d832e req-582d2ab8-2d8b-4e68-9c67-eabc7f247389 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:53.360777 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-32fb940b-a4d9-4861-b106-6bb84c7d832e req-582d2ab8-2d8b-4e68-9c67-eabc7f247389 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:53.371428 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-32fb940b-a4d9-4861-b106-6bb84c7d832e req-582d2ab8-2d8b-4e68-9c67-eabc7f247389 service nova] Creating event network-vif-plugged:d9ff1e9e-ad49-4446-85dc-750360ad4de7 for instance e660d346-4a6c-4328-b2ab-34f3c8d2af0f on hv-cinder-84773 Jun 27 09:39:53.376459 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-32fb940b-a4d9-4861-b106-6bb84c7d832e req-582d2ab8-2d8b-4e68-9c67-eabc7f247389 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028782 Jun 27 09:39:53.377036 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 266/509] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:39:54.269652 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-d44a0d04-2aba-403d-a2da-750aff70af5b tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:54.272087 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-d44a0d04-2aba-403d-a2da-750aff70af5b tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:54.277520 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d44a0d04-2aba-403d-a2da-750aff70af5b tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:54.278064 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d44a0d04-2aba-403d-a2da-750aff70af5b tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:54.278842 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d44a0d04-2aba-403d-a2da-750aff70af5b tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:54.279283 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d44a0d04-2aba-403d-a2da-750aff70af5b tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:54.364388 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-8ab7aaf9-250d-4373-b88f-1e6688e71272 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:54.365092 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-8ab7aaf9-250d-4373-b88f-1e6688e71272 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:54.371912 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8ab7aaf9-250d-4373-b88f-1e6688e71272 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:54.373151 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8ab7aaf9-250d-4373-b88f-1e6688e71272 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:54.373262 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8ab7aaf9-250d-4373-b88f-1e6688e71272 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:54.373649 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8ab7aaf9-250d-4373-b88f-1e6688e71272 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:54.410371 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d44a0d04-2aba-403d-a2da-750aff70af5b tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:54.418668 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-d44a0d04-2aba-403d-a2da-750aff70af5b tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 200 len: 1314 microversion: 2.1 time: 0.152863 Jun 27 09:39:54.419237 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 244/510] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:54 2022] GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:54.505752 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-8ab7aaf9-250d-4373-b88f-1e6688e71272 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:54.513838 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-8ab7aaf9-250d-4373-b88f-1e6688e71272 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1556 microversion: 2.1 time: 0.153536 Jun 27 09:39:54.514344 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 267/511] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:54 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:54.534304 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-cd05298b-e412-4112-9be8-caf5f5b11bfe tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:54.534797 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-cd05298b-e412-4112-9be8-caf5f5b11bfe tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:54.540784 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cd05298b-e412-4112-9be8-caf5f5b11bfe tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:54.541474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cd05298b-e412-4112-9be8-caf5f5b11bfe tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:54.542266 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cd05298b-e412-4112-9be8-caf5f5b11bfe tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:54.543076 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cd05298b-e412-4112-9be8-caf5f5b11bfe tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:54.623252 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-cd05298b-e412-4112-9be8-caf5f5b11bfe tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092678 Jun 27 09:39:54.623993 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 245/512] 10.222.0.64 () {58 vars in 1274 bytes} [Mon Jun 27 09:39:54 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:39:54.707062 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-74e58fec-4c98-4ed1-a83c-379eecf41495 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49428e7d-b2d7-4ffc-bcab-1b92c5c10c0e"}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:54.708168 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-74e58fec-4c98-4ed1-a83c-379eecf41495 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:54.714657 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-74e58fec-4c98-4ed1-a83c-379eecf41495 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:54.715111 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-74e58fec-4c98-4ed1-a83c-379eecf41495 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:54.716017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-74e58fec-4c98-4ed1-a83c-379eecf41495 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:54.719456 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-74e58fec-4c98-4ed1-a83c-379eecf41495 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:55.423655 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c30a4942-e1de-4f27-a98a-8100c09fd9a2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8dd4a5f5-3f56-4b91-9544-ecb781fa03fe"}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:55.424764 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-c30a4942-e1de-4f27-a98a-8100c09fd9a2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:55.430848 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c30a4942-e1de-4f27-a98a-8100c09fd9a2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:55.431499 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c30a4942-e1de-4f27-a98a-8100c09fd9a2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:55.432494 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c30a4942-e1de-4f27-a98a-8100c09fd9a2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:55.433085 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c30a4942-e1de-4f27-a98a-8100c09fd9a2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:55.484272 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-74e58fec-4c98-4ed1-a83c-379eecf41495 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "POST /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.780760 Jun 27 09:39:55.485462 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 268/513] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 27 09:39:54 2022] POST /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129/os-volume_attachments => generated 194 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:39:55.491310 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-8aba2bc8-4783-4470-b5dd-fce61846097d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:55.492164 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-8aba2bc8-4783-4470-b5dd-fce61846097d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:55.498796 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8aba2bc8-4783-4470-b5dd-fce61846097d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:55.499254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8aba2bc8-4783-4470-b5dd-fce61846097d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:55.500059 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8aba2bc8-4783-4470-b5dd-fce61846097d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:55.500488 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8aba2bc8-4783-4470-b5dd-fce61846097d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:55.724023 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-8aba2bc8-4783-4470-b5dd-fce61846097d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:55.731778 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-8aba2bc8-4783-4470-b5dd-fce61846097d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 200 len: 1314 microversion: 2.1 time: 0.244798 Jun 27 09:39:55.741057 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 269/514] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:55 2022] GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:55.745875 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-c5e2f1ab-f355-4bdf-891f-6884f4255580 req-073ec270-ecef-4235-ad56-186dae161e42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "102adf3a-476d-4af7-8267-15e963425bde", "tag": "1c045054-5e3a-4e2b-8877-18f92b60b5a0"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:55.753967 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-c5e2f1ab-f355-4bdf-891f-6884f4255580 req-073ec270-ecef-4235-ad56-186dae161e42 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:55.754418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-c5e2f1ab-f355-4bdf-891f-6884f4255580 req-073ec270-ecef-4235-ad56-186dae161e42 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:55.765809 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-c5e2f1ab-f355-4bdf-891f-6884f4255580 req-073ec270-ecef-4235-ad56-186dae161e42 service nova] Creating event network-changed:1c045054-5e3a-4e2b-8877-18f92b60b5a0 for instance 102adf3a-476d-4af7-8267-15e963425bde on hv-cinder-84773 Jun 27 09:39:55.770707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-c5e2f1ab-f355-4bdf-891f-6884f4255580 req-073ec270-ecef-4235-ad56-186dae161e42 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028407 Jun 27 09:39:55.771561 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 270/515] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:39:56.584891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-c30a4942-e1de-4f27-a98a-8100c09fd9a2 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "POST /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.165445 Jun 27 09:39:56.585900 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 246/516] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 27 09:39:55 2022] POST /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3/os-volume_attachments => generated 194 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:39:56.749930 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-04e1165b-0fef-4f5e-9134-d662a7ad0a0d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:56.750626 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-04e1165b-0fef-4f5e-9134-d662a7ad0a0d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:56.757229 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-04e1165b-0fef-4f5e-9134-d662a7ad0a0d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:56.757713 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-04e1165b-0fef-4f5e-9134-d662a7ad0a0d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:56.758484 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-04e1165b-0fef-4f5e-9134-d662a7ad0a0d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:56.758923 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-04e1165b-0fef-4f5e-9134-d662a7ad0a0d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:56.891609 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-04e1165b-0fef-4f5e-9134-d662a7ad0a0d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:56.900821 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-04e1165b-0fef-4f5e-9134-d662a7ad0a0d tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 200 len: 1498 microversion: 2.1 time: 0.155536 Jun 27 09:39:56.901401 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 271/517] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:56 2022] GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 1498 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:57.750040 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-326dd88b-93d4-4efd-b092-6bb49701dfe5 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:57.750628 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-326dd88b-93d4-4efd-b092-6bb49701dfe5 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:57.756974 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-326dd88b-93d4-4efd-b092-6bb49701dfe5 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:57.758091 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-326dd88b-93d4-4efd-b092-6bb49701dfe5 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:57.758894 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-326dd88b-93d4-4efd-b092-6bb49701dfe5 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:57.759353 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-326dd88b-93d4-4efd-b092-6bb49701dfe5 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:57.783751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-326dd88b-93d4-4efd-b092-6bb49701dfe5 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Going to try to terminate instance {{(pid=124870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 09:39:58.037589 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-326dd88b-93d4-4efd-b092-6bb49701dfe5 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 204 len: 0 microversion: 2.1 time: 0.291919 Jun 27 09:39:58.038178 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 247/518] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:39:57 2022] DELETE /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 09:39:58.052730 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-3fe612f5-38b8-4103-9c50-db30fa619b57 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:58.053377 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-3fe612f5-38b8-4103-9c50-db30fa619b57 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:58.060584 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3fe612f5-38b8-4103-9c50-db30fa619b57 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:58.061037 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3fe612f5-38b8-4103-9c50-db30fa619b57 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:58.061799 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3fe612f5-38b8-4103-9c50-db30fa619b57 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:58.062242 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3fe612f5-38b8-4103-9c50-db30fa619b57 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:58.202629 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-3fe612f5-38b8-4103-9c50-db30fa619b57 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:58.210122 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-3fe612f5-38b8-4103-9c50-db30fa619b57 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 200 len: 1504 microversion: 2.1 time: 0.161308 Jun 27 09:39:58.211297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 272/519] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:58 2022] GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:39:58.706812 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-56b2f41f-27a7-4ca1-ae9d-0dc4e5b306ef tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1723161256", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-205470936", "security_groups": [{"name": "tempest-secgroup-smoke-1479690552"}], "block_device_mapping_v2": [{"uuid": "644288a6-968a-4a7d-ac5e-f147505fad3e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "55f28e02-5cc3-4eaa-863b-67aabfa62103"}]}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:39:58.719494 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:58.823571 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.network.neutron [None req-56b2f41f-27a7-4ca1-ae9d-0dc4e5b306ef tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] validate_networks() for [('55f28e02-5cc3-4eaa-863b-67aabfa62103', None, None, None, None, None)] {{(pid=124870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 09:39:59.181419 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-56b2f41f-27a7-4ca1-ae9d-0dc4e5b306ef tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Flavor limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 09:39:59.181844 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-56b2f41f-27a7-4ca1-ae9d-0dc4e5b306ef tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Image limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 09:39:59.182309 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-56b2f41f-27a7-4ca1-ae9d-0dc4e5b306ef tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Flavor pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 09:39:59.182715 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-56b2f41f-27a7-4ca1-ae9d-0dc4e5b306ef tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Image pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 09:39:59.183117 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-56b2f41f-27a7-4ca1-ae9d-0dc4e5b306ef tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 09:39:59.191874 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-56b2f41f-27a7-4ca1-ae9d-0dc4e5b306ef tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:59.192316 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-56b2f41f-27a7-4ca1-ae9d-0dc4e5b306ef tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:59.193102 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-56b2f41f-27a7-4ca1-ae9d-0dc4e5b306ef tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:59.193530 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-56b2f41f-27a7-4ca1-ae9d-0dc4e5b306ef tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:59.209803 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-56b2f41f-27a7-4ca1-ae9d-0dc4e5b306ef tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Getting quotas for project 1d5cbd080e204408aa51c29ec2cf1422. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:39:59.214269 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-56b2f41f-27a7-4ca1-ae9d-0dc4e5b306ef tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Getting quotas for user 2720d45854ab4a61b3b22dd43a523d4b and project 1d5cbd080e204408aa51c29ec2cf1422. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:39:59.227707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e5e04c32-17d2-49cb-b467-65fd16cf88c5 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:59.228419 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-e5e04c32-17d2-49cb-b467-65fd16cf88c5 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:59.234620 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e5e04c32-17d2-49cb-b467-65fd16cf88c5 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:59.235066 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e5e04c32-17d2-49cb-b467-65fd16cf88c5 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:59.235863 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e5e04c32-17d2-49cb-b467-65fd16cf88c5 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:39:59.236381 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e5e04c32-17d2-49cb-b467-65fd16cf88c5 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:39:59.270977 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-56b2f41f-27a7-4ca1-ae9d-0dc4e5b306ef tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Going to run 1 instances... {{(pid=124870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 09:39:59.273735 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-56b2f41f-27a7-4ca1-ae9d-0dc4e5b306ef tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='644288a6-968a-4a7d-ac5e-f147505fad3e',volume_size=None,volume_type=None)] {{(pid=124870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 09:39:59.365424 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e5e04c32-17d2-49cb-b467-65fd16cf88c5 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:59.372993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-e5e04c32-17d2-49cb-b467-65fd16cf88c5 tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 200 len: 1504 microversion: 2.1 time: 0.149777 Jun 27 09:39:59.373631 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 273/520] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:59 2022] GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:39:59.640652 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-56b2f41f-27a7-4ca1-ae9d-0dc4e5b306ef tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.938281 Jun 27 09:39:59.641267 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 248/521] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 27 09:39:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 09:39:59.651877 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-41bbca90-1bc9-4ba7-8d8b-372c51183933 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:39:59.652501 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-41bbca90-1bc9-4ba7-8d8b-372c51183933 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:39:59.662471 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:39:59.708037 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-41bbca90-1bc9-4ba7-8d8b-372c51183933 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:39:59.714674 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-41bbca90-1bc9-4ba7-8d8b-372c51183933 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1094 microversion: 2.1 time: 0.067289 Jun 27 09:39:59.715268 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 274/522] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:39:59 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:00.389735 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-6b333112-ad93-40e5-a577-bee83518012c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:00.390340 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-6b333112-ad93-40e5-a577-bee83518012c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:00.397030 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6b333112-ad93-40e5-a577-bee83518012c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:00.397478 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6b333112-ad93-40e5-a577-bee83518012c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:00.398867 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6b333112-ad93-40e5-a577-bee83518012c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:00.399309 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6b333112-ad93-40e5-a577-bee83518012c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:00.485941 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-6b333112-ad93-40e5-a577-bee83518012c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:00.493844 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-6b333112-ad93-40e5-a577-bee83518012c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 200 len: 1462 microversion: 2.1 time: 0.108010 Jun 27 09:40:00.494528 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 249/523] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:00 2022] GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 1462 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:00.719247 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-cc3b8a09-96e8-4ce9-bb5c-7711b454f3ff req-c91c6b2a-bac8-46f9-a7ab-f0aa7320c17b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e660d346-4a6c-4328-b2ab-34f3c8d2af0f", "name": "network-vif-deleted", "tag": "d9ff1e9e-ad49-4446-85dc-750360ad4de7"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:40:00.730099 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-cc3b8a09-96e8-4ce9-bb5c-7711b454f3ff req-c91c6b2a-bac8-46f9-a7ab-f0aa7320c17b service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:00.730539 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-cc3b8a09-96e8-4ce9-bb5c-7711b454f3ff req-c91c6b2a-bac8-46f9-a7ab-f0aa7320c17b service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:00.731161 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-6a6366c5-4158-4609-a41d-08bc8d0e4a2c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:00.731928 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-6a6366c5-4158-4609-a41d-08bc8d0e4a2c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:00.743143 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6a6366c5-4158-4609-a41d-08bc8d0e4a2c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:00.743143 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6a6366c5-4158-4609-a41d-08bc8d0e4a2c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:00.743143 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6a6366c5-4158-4609-a41d-08bc8d0e4a2c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:00.743143 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6a6366c5-4158-4609-a41d-08bc8d0e4a2c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:00.743720 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-cc3b8a09-96e8-4ce9-bb5c-7711b454f3ff req-c91c6b2a-bac8-46f9-a7ab-f0aa7320c17b service nova] Creating event network-vif-deleted:d9ff1e9e-ad49-4446-85dc-750360ad4de7 for instance e660d346-4a6c-4328-b2ab-34f3c8d2af0f on hv-cinder-84773 Jun 27 09:40:00.748086 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-cc3b8a09-96e8-4ce9-bb5c-7711b454f3ff req-c91c6b2a-bac8-46f9-a7ab-f0aa7320c17b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032278 Jun 27 09:40:00.748858 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 275/524] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:40:00.803480 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-6a6366c5-4158-4609-a41d-08bc8d0e4a2c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:00.813102 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-6a6366c5-4158-4609-a41d-08bc8d0e4a2c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1144 microversion: 2.1 time: 0.085173 Jun 27 09:40:00.813689 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 250/525] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:00 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:40:01.510692 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-39f16e83-6cc6-4838-a30b-68b572ed4c6c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:01.511387 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-39f16e83-6cc6-4838-a30b-68b572ed4c6c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:01.517731 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-39f16e83-6cc6-4838-a30b-68b572ed4c6c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:01.518209 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-39f16e83-6cc6-4838-a30b-68b572ed4c6c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:01.518964 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-39f16e83-6cc6-4838-a30b-68b572ed4c6c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:01.519399 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-39f16e83-6cc6-4838-a30b-68b572ed4c6c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:01.549964 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-39f16e83-6cc6-4838-a30b-68b572ed4c6c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:01.550333 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-39f16e83-6cc6-4838-a30b-68b572ed4c6c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:01.550774 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.objects.instance [None req-39f16e83-6cc6-4838-a30b-68b572ed4c6c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lazy-loading 'fault' on Instance uuid e660d346-4a6c-4328-b2ab-34f3c8d2af0f {{(pid=124869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:40:01.592016 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-39f16e83-6cc6-4838-a30b-68b572ed4c6c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09f242a8f51545199a159f6992ee74f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604921be35cc4c258933114a5535800c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:01.599392 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-39f16e83-6cc6-4838-a30b-68b572ed4c6c tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 200 len: 1304 microversion: 2.1 time: 0.092916 Jun 27 09:40:01.599973 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 276/526] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:01 2022] GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:01.830628 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-d28b4e16-1a69-43cb-87f0-eef0d6074ed3 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:01.831241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-d28b4e16-1a69-43cb-87f0-eef0d6074ed3 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:01.838402 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d28b4e16-1a69-43cb-87f0-eef0d6074ed3 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:01.838859 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d28b4e16-1a69-43cb-87f0-eef0d6074ed3 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:01.839652 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d28b4e16-1a69-43cb-87f0-eef0d6074ed3 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:01.840096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d28b4e16-1a69-43cb-87f0-eef0d6074ed3 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:01.907283 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d28b4e16-1a69-43cb-87f0-eef0d6074ed3 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:01.910693 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:01.915110 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-d28b4e16-1a69-43cb-87f0-eef0d6074ed3 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1192 microversion: 2.1 time: 0.088396 Jun 27 09:40:01.915711 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 251/527] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:01 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1192 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:02.617942 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-08b45caf-76ba-41ea-a5e8-e7ac2c66cc9e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:02.618588 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-08b45caf-76ba-41ea-a5e8-e7ac2c66cc9e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] [instance: e660d346-4a6c-4328-b2ab-34f3c8d2af0f] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:02.621028 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell0:SELECT=2 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:02.625841 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-08b45caf-76ba-41ea-a5e8-e7ac2c66cc9e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:02.626292 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-08b45caf-76ba-41ea-a5e8-e7ac2c66cc9e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:02.627051 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-08b45caf-76ba-41ea-a5e8-e7ac2c66cc9e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:02.627488 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-08b45caf-76ba-41ea-a5e8-e7ac2c66cc9e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:02.640818 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-08b45caf-76ba-41ea-a5e8-e7ac2c66cc9e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] HTTP exception thrown: Instance e660d346-4a6c-4328-b2ab-34f3c8d2af0f could not be found. Jun 27 09:40:02.642343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-08b45caf-76ba-41ea-a5e8-e7ac2c66cc9e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Request method failure captured: Jun 27 09:40:02.642343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f HTTP/1.1 Jun 27 09:40:02.642343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:40:02.642343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:40:02.642343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:40:02.642343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:40:02.642343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:40:02.642343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:40:02.642343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:40:02.642343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:40:02.642343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXqi-ehhcSy_2jmYXAVB8mquIZm6y-d9lRH8ZCRZLUXd2NbyI8ZcLyxVx6B-JLsydlbHauSeQGvCjy2FlPWgyoKTFcS82xXENu6a4q5U6V-aZNM1EPrs3bNCV-B2uYrEzcutZjkHPSrG7OpP4ligWW18A6UOHJ6YdP5vx4jcVQ9Xb_E Jun 27 09:40:02.642343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:40:02.642343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:40:02.642343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:40:02.642343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:40:02.642343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:40:02.642343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:40:02.642343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: 604921be35cc4c258933114a5535800c Jun 27 09:40:02.642343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-VolumesActionsTest-2055227002 Jun 27 09:40:02.642343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:40:02.642343 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:40:02.643955 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/604921be35cc4c258933114a5535800c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/604921be35cc4c258933114a5535800c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/604921be35cc4c258933114a5535800c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_604921be35cc4c258933114a5535800c", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:40:02.643955 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-VolumesActionsTest-2055227002 Jun 27 09:40:02.643955 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: 604921be35cc4c258933114a5535800c Jun 27 09:40:02.643955 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-VolumesActionsTest-2055227002 Jun 27 09:40:02.643955 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-VolumesActionsTest-2055227002-project Jun 27 09:40:02.643955 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:40:02.643955 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:40:02.643955 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: 09f242a8f51545199a159f6992ee74f1 Jun 27 09:40:02.643955 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-VolumesActionsTest-2055227002-project Jun 27 09:40:02.643955 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: > Jun 27 09:40:02.643955 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Instance e660d346-4a6c-4328-b2ab-34f3c8d2af0f could not be found. Jun 27 09:40:02.643955 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'id': 'e660d346-4a6c-4328-b2ab-34f3c8d2af0f'} Jun 27 09:40:02.644806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:40:02.644806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:40:02.644806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:40:02.644806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:40:02.644806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:40:02.644806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:40:02.644806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:40:02.644806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:40:02.644806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:40:02.644806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:40:02.644806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e660d346-4a6c-4328-b2ab-34f3c8d2af0f could not be found. Jun 27 09:40:02.644806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:40:02.644806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:40:02.644806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:40:02.644806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:40:02.644806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:40:02.644806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:40:02.644806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:40:02.644806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:40:02.644806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:40:02.646284 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:40:02.646284 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:40:02.646284 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:40:02.646284 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:40:02.646284 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:40:02.646284 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:40:02.646284 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:40:02.646284 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e660d346-4a6c-4328-b2ab-34f3c8d2af0f could not be found. Jun 27 09:40:02.646284 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:40:02.646284 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:40:02.646284 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:40:02.646284 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:40:02.646284 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:40:02.646284 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:40:02.646284 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:40:02.646284 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:40:02.646284 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e660d346-4a6c-4328-b2ab-34f3c8d2af0f could not be found. Jun 27 09:40:02.646284 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:40:02.648146 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-08b45caf-76ba-41ea-a5e8-e7ac2c66cc9e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] Returning 404 to user: Instance e660d346-4a6c-4328-b2ab-34f3c8d2af0f could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:40:02.648146 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-08b45caf-76ba-41ea-a5e8-e7ac2c66cc9e tempest-VolumesActionsTest-2055227002 tempest-VolumesActionsTest-2055227002-project] 10.222.0.64 "GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f" status: 404 len: 111 microversion: 2.1 time: 0.030268 Jun 27 09:40:02.648146 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 277/528] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:02 2022] GET /compute/v2.1/servers/e660d346-4a6c-4328-b2ab-34f3c8d2af0f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:40:02.932722 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-48662585-cd8e-4334-8ec6-566d6365adb5 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:02.933599 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-48662585-cd8e-4334-8ec6-566d6365adb5 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:02.941985 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-48662585-cd8e-4334-8ec6-566d6365adb5 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:02.942555 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-48662585-cd8e-4334-8ec6-566d6365adb5 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:02.943594 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-48662585-cd8e-4334-8ec6-566d6365adb5 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:02.944287 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-48662585-cd8e-4334-8ec6-566d6365adb5 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:03.029346 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-48662585-cd8e-4334-8ec6-566d6365adb5 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:03.036807 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-48662585-cd8e-4334-8ec6-566d6365adb5 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1210 microversion: 2.1 time: 0.107854 Jun 27 09:40:03.037723 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 252/529] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:02 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1210 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:04.054717 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-9e3db75e-2a86-4b64-8a13-49bb043db65f tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:04.055332 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-9e3db75e-2a86-4b64-8a13-49bb043db65f tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:04.062952 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9e3db75e-2a86-4b64-8a13-49bb043db65f tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:04.063630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9e3db75e-2a86-4b64-8a13-49bb043db65f tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:04.065277 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9e3db75e-2a86-4b64-8a13-49bb043db65f tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:04.066365 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9e3db75e-2a86-4b64-8a13-49bb043db65f tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:04.201262 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-0211f462-f9fd-470d-b070-d3311b75b04e req-7b015999-54cb-47ae-b8de-d823151db796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cb9074b-9ac1-4780-ab45-dde1641b83e3", "tag": "6668e5f8-1a3b-4d07-a99b-2feabc1b8262"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:40:04.214355 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-0211f462-f9fd-470d-b070-d3311b75b04e req-7b015999-54cb-47ae-b8de-d823151db796 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:04.214802 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-0211f462-f9fd-470d-b070-d3311b75b04e req-7b015999-54cb-47ae-b8de-d823151db796 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:04.245427 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-0211f462-f9fd-470d-b070-d3311b75b04e req-7b015999-54cb-47ae-b8de-d823151db796 service nova] Creating event network-changed:6668e5f8-1a3b-4d07-a99b-2feabc1b8262 for instance 3cb9074b-9ac1-4780-ab45-dde1641b83e3 on hv-cinder-84773 Jun 27 09:40:04.253309 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-0211f462-f9fd-470d-b070-d3311b75b04e req-7b015999-54cb-47ae-b8de-d823151db796 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055848 Jun 27 09:40:04.258708 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 253/530] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:40:04.343094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-9e3db75e-2a86-4b64-8a13-49bb043db65f tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:04.344668 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-3dab4d6b-fd32-4fb2-bcaf-05d836526b2a tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:04.350470 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-3dab4d6b-fd32-4fb2-bcaf-05d836526b2a tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:04.353058 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3dab4d6b-fd32-4fb2-bcaf-05d836526b2a tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:04.353688 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3dab4d6b-fd32-4fb2-bcaf-05d836526b2a tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:04.354151 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-9e3db75e-2a86-4b64-8a13-49bb043db65f tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1278 microversion: 2.1 time: 0.303055 Jun 27 09:40:04.354816 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3dab4d6b-fd32-4fb2-bcaf-05d836526b2a tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:04.355190 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 278/531] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:04 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1278 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:04.355615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3dab4d6b-fd32-4fb2-bcaf-05d836526b2a tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:04.492679 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-3dab4d6b-fd32-4fb2-bcaf-05d836526b2a tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:04.501801 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-3dab4d6b-fd32-4fb2-bcaf-05d836526b2a tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1593 microversion: 2.1 time: 0.161129 Jun 27 09:40:04.502382 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 254/532] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:04 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1593 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:05.370140 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-d6ca8830-c66a-4c89-a54f-6b31ac9148c4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:05.370750 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-d6ca8830-c66a-4c89-a54f-6b31ac9148c4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:05.377541 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d6ca8830-c66a-4c89-a54f-6b31ac9148c4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:05.377989 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d6ca8830-c66a-4c89-a54f-6b31ac9148c4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:05.378752 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d6ca8830-c66a-4c89-a54f-6b31ac9148c4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:05.379189 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d6ca8830-c66a-4c89-a54f-6b31ac9148c4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:05.619089 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-d6ca8830-c66a-4c89-a54f-6b31ac9148c4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:05.626637 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-d6ca8830-c66a-4c89-a54f-6b31ac9148c4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1278 microversion: 2.1 time: 0.260296 Jun 27 09:40:05.627197 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 279/533] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:05 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1278 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:06.614258 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-159d1120-2ca4-4eaf-8128-899686842847 req-d26d94c6-b19f-4b7b-a5d2-e70d497f2e48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129", "tag": "b7d364ab-ebca-4312-8213-6c5cc722e7bc"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:40:06.623181 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-159d1120-2ca4-4eaf-8128-899686842847 req-d26d94c6-b19f-4b7b-a5d2-e70d497f2e48 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:06.623655 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-159d1120-2ca4-4eaf-8128-899686842847 req-d26d94c6-b19f-4b7b-a5d2-e70d497f2e48 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:06.636099 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-159d1120-2ca4-4eaf-8128-899686842847 req-d26d94c6-b19f-4b7b-a5d2-e70d497f2e48 service nova] Creating event network-changed:b7d364ab-ebca-4312-8213-6c5cc722e7bc for instance b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 on hv-cinder-84773 Jun 27 09:40:06.642947 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-0c7fc8ea-60b2-4649-94a9-7fabbe59328d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:06.643582 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-0c7fc8ea-60b2-4649-94a9-7fabbe59328d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:06.651114 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0c7fc8ea-60b2-4649-94a9-7fabbe59328d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:06.651300 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-159d1120-2ca4-4eaf-8128-899686842847 req-d26d94c6-b19f-4b7b-a5d2-e70d497f2e48 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040325 Jun 27 09:40:06.651960 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 255/534] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:40:06.652078 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0c7fc8ea-60b2-4649-94a9-7fabbe59328d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:06.652595 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0c7fc8ea-60b2-4649-94a9-7fabbe59328d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:06.653030 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0c7fc8ea-60b2-4649-94a9-7fabbe59328d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:06.795073 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-0c7fc8ea-60b2-4649-94a9-7fabbe59328d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:06.803255 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-0c7fc8ea-60b2-4649-94a9-7fabbe59328d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1278 microversion: 2.1 time: 0.164025 Jun 27 09:40:06.804128 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 280/535] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:06 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:07.820956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-94c0732e-de97-4f22-bfd8-11fb8cf5882d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:07.821660 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-94c0732e-de97-4f22-bfd8-11fb8cf5882d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:07.829322 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-94c0732e-de97-4f22-bfd8-11fb8cf5882d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:07.829784 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-94c0732e-de97-4f22-bfd8-11fb8cf5882d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:07.830562 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-94c0732e-de97-4f22-bfd8-11fb8cf5882d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:07.831091 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-94c0732e-de97-4f22-bfd8-11fb8cf5882d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:08.007764 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-94c0732e-de97-4f22-bfd8-11fb8cf5882d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:08.014363 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-94c0732e-de97-4f22-bfd8-11fb8cf5882d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1278 microversion: 2.1 time: 0.197751 Jun 27 09:40:08.014922 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 256/536] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:07 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1278 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:09.032041 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-b4acdc81-65d2-468c-af92-81da7f8a8c35 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:09.033490 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-b4acdc81-65d2-468c-af92-81da7f8a8c35 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:09.041499 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b4acdc81-65d2-468c-af92-81da7f8a8c35 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:09.042248 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b4acdc81-65d2-468c-af92-81da7f8a8c35 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:09.043411 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b4acdc81-65d2-468c-af92-81da7f8a8c35 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:09.044068 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b4acdc81-65d2-468c-af92-81da7f8a8c35 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:09.048665 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:09.151237 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-4e83b1ce-e8c8-498b-a3d9-d05a31f27922 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1617501367"}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:40:09.151800 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-4e83b1ce-e8c8-498b-a3d9-d05a31f27922 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:09.164438 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4e83b1ce-e8c8-498b-a3d9-d05a31f27922 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:09.164904 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4e83b1ce-e8c8-498b-a3d9-d05a31f27922 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:09.167841 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4e83b1ce-e8c8-498b-a3d9-d05a31f27922 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:09.168314 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4e83b1ce-e8c8-498b-a3d9-d05a31f27922 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:09.200527 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=2 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:09.216699 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-b4acdc81-65d2-468c-af92-81da7f8a8c35 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:09.240153 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-b4acdc81-65d2-468c-af92-81da7f8a8c35 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1278 microversion: 2.1 time: 0.212237 Jun 27 09:40:09.240758 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 281/537] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:09 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1278 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:09.241516 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=6 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:09.377835 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.network.security_group_api [None req-4e83b1ce-e8c8-498b-a3d9-d05a31f27922 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Adding security group 75558118-58f1-4617-91d1-20932d4db53c to port b7d364ab-ebca-4312-8213-6c5cc722e7bc Jun 27 09:40:09.861015 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-4e83b1ce-e8c8-498b-a3d9-d05a31f27922 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "POST /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129/action" status: 202 len: 0 microversion: 2.1 time: 0.714084 Jun 27 09:40:09.861830 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 257/538] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 27 09:40:09 2022] POST /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129/action => generated 0 bytes in 716 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 09:40:09.865550 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell0:SELECT=2 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:09.870144 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-e1b727ea-e02f-486d-8842-1ecaa339bc03 req-5f380f59-1fa7-4b3e-9bb4-71cb12e3c3f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129", "tag": "b7d364ab-ebca-4312-8213-6c5cc722e7bc"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:40:09.879640 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-60d5ea6b-e492-4d9c-b79b-532845828c3f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:09.880264 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-60d5ea6b-e492-4d9c-b79b-532845828c3f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:09.892571 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-60d5ea6b-e492-4d9c-b79b-532845828c3f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:09.893022 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-60d5ea6b-e492-4d9c-b79b-532845828c3f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:09.898361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-60d5ea6b-e492-4d9c-b79b-532845828c3f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:09.898361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-60d5ea6b-e492-4d9c-b79b-532845828c3f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:09.898581 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-e1b727ea-e02f-486d-8842-1ecaa339bc03 req-5f380f59-1fa7-4b3e-9bb4-71cb12e3c3f1 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:09.898581 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-e1b727ea-e02f-486d-8842-1ecaa339bc03 req-5f380f59-1fa7-4b3e-9bb4-71cb12e3c3f1 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:09.922331 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-e1b727ea-e02f-486d-8842-1ecaa339bc03 req-5f380f59-1fa7-4b3e-9bb4-71cb12e3c3f1 service nova] Creating event network-changed:b7d364ab-ebca-4312-8213-6c5cc722e7bc for instance b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 on hv-cinder-84773 Jun 27 09:40:09.928013 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-e1b727ea-e02f-486d-8842-1ecaa339bc03 req-5f380f59-1fa7-4b3e-9bb4-71cb12e3c3f1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063216 Jun 27 09:40:09.929199 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 282/539] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:40:10.130141 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-60d5ea6b-e492-4d9c-b79b-532845828c3f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:10.143285 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-60d5ea6b-e492-4d9c-b79b-532845828c3f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1759 microversion: 2.1 time: 0.269404 Jun 27 09:40:10.156951 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 258/540] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:09 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1759 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:10.260562 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-971f2dd1-af75-470f-8972-be51c1d2fb7d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:10.261892 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-971f2dd1-af75-470f-8972-be51c1d2fb7d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:10.280956 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-971f2dd1-af75-470f-8972-be51c1d2fb7d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:10.280956 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-971f2dd1-af75-470f-8972-be51c1d2fb7d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:10.280956 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-971f2dd1-af75-470f-8972-be51c1d2fb7d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:10.280956 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-971f2dd1-af75-470f-8972-be51c1d2fb7d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:10.536276 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-971f2dd1-af75-470f-8972-be51c1d2fb7d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:10.546782 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-971f2dd1-af75-470f-8972-be51c1d2fb7d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1278 microversion: 2.1 time: 0.292536 Jun 27 09:40:10.547359 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 283/541] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:10 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1278 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:11.568136 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-7c6d61fa-631a-4933-8d51-ff31ec19a483 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:11.570155 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-7c6d61fa-631a-4933-8d51-ff31ec19a483 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:11.579332 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7c6d61fa-631a-4933-8d51-ff31ec19a483 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:11.579978 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7c6d61fa-631a-4933-8d51-ff31ec19a483 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:11.583704 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7c6d61fa-631a-4933-8d51-ff31ec19a483 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:11.584867 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7c6d61fa-631a-4933-8d51-ff31ec19a483 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:11.751002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-a69826dc-22f4-4f23-b84d-390125bebe05 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:40:11.752073 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-a69826dc-22f4-4f23-b84d-390125bebe05 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:11.761160 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a69826dc-22f4-4f23-b84d-390125bebe05 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:11.762634 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a69826dc-22f4-4f23-b84d-390125bebe05 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:11.766508 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a69826dc-22f4-4f23-b84d-390125bebe05 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:11.768008 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a69826dc-22f4-4f23-b84d-390125bebe05 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:11.799554 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.objects.instance [None req-a69826dc-22f4-4f23-b84d-390125bebe05 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lazy-loading 'flavor' on Instance uuid bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 {{(pid=124869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:40:11.805557 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-7c6d61fa-631a-4933-8d51-ff31ec19a483 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:11.808305 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-7c6d61fa-631a-4933-8d51-ff31ec19a483 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1278 microversion: 2.1 time: 0.247622 Jun 27 09:40:11.809086 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 259/542] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:11 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1278 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:12.414052 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-a69826dc-22f4-4f23-b84d-390125bebe05 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "POST /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3/action" status: 200 len: 32 microversion: 2.1 time: 0.667440 Jun 27 09:40:12.414952 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 284/543] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 27 09:40:11 2022] POST /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3/action => generated 32 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 27 09:40:12.425080 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-daf88f84-ed96-482a-9205-c2c05c579886 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:12.425691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-daf88f84-ed96-482a-9205-c2c05c579886 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:12.433027 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-daf88f84-ed96-482a-9205-c2c05c579886 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:12.433745 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-daf88f84-ed96-482a-9205-c2c05c579886 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:12.434512 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-daf88f84-ed96-482a-9205-c2c05c579886 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:12.434976 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-daf88f84-ed96-482a-9205-c2c05c579886 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:12.595251 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-daf88f84-ed96-482a-9205-c2c05c579886 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:12.605418 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-daf88f84-ed96-482a-9205-c2c05c579886 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1737 microversion: 2.1 time: 0.184572 Jun 27 09:40:12.607819 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 260/544] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:12 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1737 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:12.826702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e1e4cdf9-4e2a-4027-b853-1ded080914fe tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:12.827395 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-e1e4cdf9-4e2a-4027-b853-1ded080914fe tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:12.834565 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e1e4cdf9-4e2a-4027-b853-1ded080914fe tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:12.837441 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e1e4cdf9-4e2a-4027-b853-1ded080914fe tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:12.837441 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e1e4cdf9-4e2a-4027-b853-1ded080914fe tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:12.837441 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e1e4cdf9-4e2a-4027-b853-1ded080914fe tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:13.004626 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e1e4cdf9-4e2a-4027-b853-1ded080914fe tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:13.017382 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-e1e4cdf9-4e2a-4027-b853-1ded080914fe tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1266 microversion: 2.1 time: 0.195965 Jun 27 09:40:13.018054 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 285/545] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:12 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:13.626158 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e97dcaa6-5183-4c59-88ae-eef8bebe00ba tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:13.627391 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e97dcaa6-5183-4c59-88ae-eef8bebe00ba tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:13.635111 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e97dcaa6-5183-4c59-88ae-eef8bebe00ba tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:13.636132 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e97dcaa6-5183-4c59-88ae-eef8bebe00ba tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:13.636923 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e97dcaa6-5183-4c59-88ae-eef8bebe00ba tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:13.637542 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e97dcaa6-5183-4c59-88ae-eef8bebe00ba tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:13.833871 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-e97dcaa6-5183-4c59-88ae-eef8bebe00ba tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:13.849893 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e97dcaa6-5183-4c59-88ae-eef8bebe00ba tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1737 microversion: 2.1 time: 0.227683 Jun 27 09:40:13.850787 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 261/546] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:13 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:14.038791 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-03f282d2-cca3-4dbb-bf70-abfef434e78c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:14.040466 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-03f282d2-cca3-4dbb-bf70-abfef434e78c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:14.047401 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-03f282d2-cca3-4dbb-bf70-abfef434e78c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:14.051522 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-03f282d2-cca3-4dbb-bf70-abfef434e78c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:14.051522 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-03f282d2-cca3-4dbb-bf70-abfef434e78c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:14.051522 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-03f282d2-cca3-4dbb-bf70-abfef434e78c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:14.189113 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-03f282d2-cca3-4dbb-bf70-abfef434e78c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:14.200882 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-03f282d2-cca3-4dbb-bf70-abfef434e78c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1266 microversion: 2.1 time: 0.166435 Jun 27 09:40:14.201735 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 286/547] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:14 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:14.868149 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-8fc3d56c-f83d-4dc9-919c-8e8be0401bb8 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:14.868725 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-8fc3d56c-f83d-4dc9-919c-8e8be0401bb8 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:14.875802 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8fc3d56c-f83d-4dc9-919c-8e8be0401bb8 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:14.876251 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8fc3d56c-f83d-4dc9-919c-8e8be0401bb8 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:14.877036 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8fc3d56c-f83d-4dc9-919c-8e8be0401bb8 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:14.877470 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8fc3d56c-f83d-4dc9-919c-8e8be0401bb8 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:15.018883 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8fc3d56c-f83d-4dc9-919c-8e8be0401bb8 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:15.027426 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-8fc3d56c-f83d-4dc9-919c-8e8be0401bb8 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1737 microversion: 2.1 time: 0.163710 Jun 27 09:40:15.028058 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 262/548] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:14 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:15.218357 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-443d5a81-10e9-4336-9897-146317192866 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:15.220431 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-443d5a81-10e9-4336-9897-146317192866 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:15.229000 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-443d5a81-10e9-4336-9897-146317192866 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:15.229468 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-443d5a81-10e9-4336-9897-146317192866 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:15.230225 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-443d5a81-10e9-4336-9897-146317192866 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:15.230679 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-443d5a81-10e9-4336-9897-146317192866 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:15.376208 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-443d5a81-10e9-4336-9897-146317192866 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:15.383687 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-443d5a81-10e9-4336-9897-146317192866 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1266 microversion: 2.1 time: 0.169575 Jun 27 09:40:15.384247 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 287/549] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:15 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:16.045478 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-9fb6b5a7-e20d-4e5e-87c5-85cb6688256d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:16.046955 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-9fb6b5a7-e20d-4e5e-87c5-85cb6688256d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:16.054792 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9fb6b5a7-e20d-4e5e-87c5-85cb6688256d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:16.055237 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9fb6b5a7-e20d-4e5e-87c5-85cb6688256d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:16.056045 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9fb6b5a7-e20d-4e5e-87c5-85cb6688256d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:16.056732 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9fb6b5a7-e20d-4e5e-87c5-85cb6688256d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:16.203318 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-9fb6b5a7-e20d-4e5e-87c5-85cb6688256d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:16.212827 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-9fb6b5a7-e20d-4e5e-87c5-85cb6688256d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1737 microversion: 2.1 time: 0.171579 Jun 27 09:40:16.222588 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 263/550] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:16 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:16.400675 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-c2492c54-3996-4b7c-ab8d-f32721b2de36 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:16.401275 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-c2492c54-3996-4b7c-ab8d-f32721b2de36 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:16.408322 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c2492c54-3996-4b7c-ab8d-f32721b2de36 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:16.408797 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c2492c54-3996-4b7c-ab8d-f32721b2de36 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:16.409615 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c2492c54-3996-4b7c-ab8d-f32721b2de36 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:16.409989 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c2492c54-3996-4b7c-ab8d-f32721b2de36 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:16.559094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-c2492c54-3996-4b7c-ab8d-f32721b2de36 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:16.568759 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-c2492c54-3996-4b7c-ab8d-f32721b2de36 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1266 microversion: 2.1 time: 0.172217 Jun 27 09:40:16.570121 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 288/551] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:16 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:17.230589 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-338429d2-7289-4a1e-8001-8d674c00755b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:17.231291 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-338429d2-7289-4a1e-8001-8d674c00755b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:17.239037 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-338429d2-7289-4a1e-8001-8d674c00755b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:17.239486 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-338429d2-7289-4a1e-8001-8d674c00755b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:17.240681 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-338429d2-7289-4a1e-8001-8d674c00755b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:17.241579 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-338429d2-7289-4a1e-8001-8d674c00755b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:17.391357 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-338429d2-7289-4a1e-8001-8d674c00755b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:17.400809 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-338429d2-7289-4a1e-8001-8d674c00755b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1737 microversion: 2.1 time: 0.174592 Jun 27 09:40:17.401647 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 264/552] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:17 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:17.588331 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-07c50209-683c-40d9-8bdf-2e6d0981d306 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:17.588993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-07c50209-683c-40d9-8bdf-2e6d0981d306 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:17.596786 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-07c50209-683c-40d9-8bdf-2e6d0981d306 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:17.597618 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-07c50209-683c-40d9-8bdf-2e6d0981d306 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:17.598698 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-07c50209-683c-40d9-8bdf-2e6d0981d306 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:17.599169 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-07c50209-683c-40d9-8bdf-2e6d0981d306 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:17.760158 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-07c50209-683c-40d9-8bdf-2e6d0981d306 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:17.768546 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-07c50209-683c-40d9-8bdf-2e6d0981d306 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1266 microversion: 2.1 time: 0.185039 Jun 27 09:40:17.769485 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 289/553] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:17 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:18.418342 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-d9e9ea49-d539-4495-9721-5df4f9297fb1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:18.419458 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-d9e9ea49-d539-4495-9721-5df4f9297fb1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:18.427496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d9e9ea49-d539-4495-9721-5df4f9297fb1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:18.432856 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d9e9ea49-d539-4495-9721-5df4f9297fb1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:18.432856 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d9e9ea49-d539-4495-9721-5df4f9297fb1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:18.432856 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d9e9ea49-d539-4495-9721-5df4f9297fb1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:18.585488 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d9e9ea49-d539-4495-9721-5df4f9297fb1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:18.598971 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-d9e9ea49-d539-4495-9721-5df4f9297fb1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1737 microversion: 2.1 time: 0.184611 Jun 27 09:40:18.616339 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 265/554] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:18 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:18.788207 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e71577c2-86e4-48b8-958f-ac3190d2327f tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:18.789717 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-e71577c2-86e4-48b8-958f-ac3190d2327f tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:18.796702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e71577c2-86e4-48b8-958f-ac3190d2327f tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:18.797520 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e71577c2-86e4-48b8-958f-ac3190d2327f tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:18.798508 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e71577c2-86e4-48b8-958f-ac3190d2327f tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:18.798948 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e71577c2-86e4-48b8-958f-ac3190d2327f tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:19.180021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e71577c2-86e4-48b8-958f-ac3190d2327f tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:19.192667 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-e71577c2-86e4-48b8-958f-ac3190d2327f tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1266 microversion: 2.1 time: 0.408519 Jun 27 09:40:19.195562 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 290/555] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:18 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1266 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:19.624946 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-278ebab3-26a7-4a05-a06f-6da6150bc721 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:19.625556 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-278ebab3-26a7-4a05-a06f-6da6150bc721 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:19.632322 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-278ebab3-26a7-4a05-a06f-6da6150bc721 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:19.633367 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-278ebab3-26a7-4a05-a06f-6da6150bc721 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:19.634162 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-278ebab3-26a7-4a05-a06f-6da6150bc721 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:19.634598 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-278ebab3-26a7-4a05-a06f-6da6150bc721 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:19.772894 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-278ebab3-26a7-4a05-a06f-6da6150bc721 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:19.782836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-278ebab3-26a7-4a05-a06f-6da6150bc721 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1737 microversion: 2.1 time: 0.161674 Jun 27 09:40:19.793035 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 266/556] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:19 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:20.210344 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-b179be16-34ba-434f-a679-450738834c58 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:20.211649 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-b179be16-34ba-434f-a679-450738834c58 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:20.218444 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b179be16-34ba-434f-a679-450738834c58 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:20.218899 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b179be16-34ba-434f-a679-450738834c58 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:20.219700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b179be16-34ba-434f-a679-450738834c58 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:20.220321 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b179be16-34ba-434f-a679-450738834c58 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:20.412315 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-b179be16-34ba-434f-a679-450738834c58 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:20.425455 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-b179be16-34ba-434f-a679-450738834c58 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1266 microversion: 2.1 time: 0.218418 Jun 27 09:40:20.427558 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 291/557] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:20 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:20.800826 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-266fb3ce-0ba0-4bf8-be2d-b3c7c258828a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:20.801442 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-266fb3ce-0ba0-4bf8-be2d-b3c7c258828a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:20.809343 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-266fb3ce-0ba0-4bf8-be2d-b3c7c258828a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:20.809793 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-266fb3ce-0ba0-4bf8-be2d-b3c7c258828a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:20.810577 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-266fb3ce-0ba0-4bf8-be2d-b3c7c258828a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:20.811024 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-266fb3ce-0ba0-4bf8-be2d-b3c7c258828a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:20.969355 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-266fb3ce-0ba0-4bf8-be2d-b3c7c258828a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:20.993169 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-266fb3ce-0ba0-4bf8-be2d-b3c7c258828a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1737 microversion: 2.1 time: 0.196215 Jun 27 09:40:20.993830 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 267/558] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:20 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1737 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:21.443417 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-12fa96f3-b540-486f-8df5-b81348732fc4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:21.444198 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-12fa96f3-b540-486f-8df5-b81348732fc4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:21.450926 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-12fa96f3-b540-486f-8df5-b81348732fc4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:21.451612 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-12fa96f3-b540-486f-8df5-b81348732fc4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:21.452692 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-12fa96f3-b540-486f-8df5-b81348732fc4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:21.453125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-12fa96f3-b540-486f-8df5-b81348732fc4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:21.595780 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-12fa96f3-b540-486f-8df5-b81348732fc4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:21.604391 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-12fa96f3-b540-486f-8df5-b81348732fc4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1266 microversion: 2.1 time: 0.164813 Jun 27 09:40:21.614173 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 292/559] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:21 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:22.010771 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-81708d1d-3872-428d-b7d6-4949c40e7655 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:22.011431 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-81708d1d-3872-428d-b7d6-4949c40e7655 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:22.020080 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-81708d1d-3872-428d-b7d6-4949c40e7655 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:22.020957 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-81708d1d-3872-428d-b7d6-4949c40e7655 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:22.021755 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-81708d1d-3872-428d-b7d6-4949c40e7655 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:22.022307 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-81708d1d-3872-428d-b7d6-4949c40e7655 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:22.161717 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-81708d1d-3872-428d-b7d6-4949c40e7655 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:22.170942 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-81708d1d-3872-428d-b7d6-4949c40e7655 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1737 microversion: 2.1 time: 0.164422 Jun 27 09:40:22.181480 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 268/560] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:22 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:22.577789 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-e5a364f6-eab4-4de1-a4e8-f501041a98fa req-b7366286-ea43-4ced-906e-593b0dcb31eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cb9074b-9ac1-4780-ab45-dde1641b83e3", "name": "network-vif-plugged", "status": "completed", "tag": "6668e5f8-1a3b-4d07-a99b-2feabc1b8262"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:40:22.588236 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-e5a364f6-eab4-4de1-a4e8-f501041a98fa req-b7366286-ea43-4ced-906e-593b0dcb31eb service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:22.588809 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-e5a364f6-eab4-4de1-a4e8-f501041a98fa req-b7366286-ea43-4ced-906e-593b0dcb31eb service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:22.600531 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-e5a364f6-eab4-4de1-a4e8-f501041a98fa req-b7366286-ea43-4ced-906e-593b0dcb31eb service nova] Creating event network-vif-plugged:6668e5f8-1a3b-4d07-a99b-2feabc1b8262 for instance 3cb9074b-9ac1-4780-ab45-dde1641b83e3 on hv-cinder-84773 Jun 27 09:40:22.607051 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-e5a364f6-eab4-4de1-a4e8-f501041a98fa req-b7366286-ea43-4ced-906e-593b0dcb31eb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032981 Jun 27 09:40:22.608248 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 293/561] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:40:22.621790 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-ab4b2fcc-0058-43fb-bdeb-f960ad989eef tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:22.622389 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-ab4b2fcc-0058-43fb-bdeb-f960ad989eef tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:22.633001 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ab4b2fcc-0058-43fb-bdeb-f960ad989eef tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:22.633449 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ab4b2fcc-0058-43fb-bdeb-f960ad989eef tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:22.634237 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ab4b2fcc-0058-43fb-bdeb-f960ad989eef tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:22.634678 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ab4b2fcc-0058-43fb-bdeb-f960ad989eef tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:22.810987 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-ab4b2fcc-0058-43fb-bdeb-f960ad989eef tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:22.820855 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-ab4b2fcc-0058-43fb-bdeb-f960ad989eef tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1266 microversion: 2.1 time: 0.202613 Jun 27 09:40:22.821795 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 269/562] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:22 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:23.188150 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-65691e1d-4040-427e-9471-c4e8ba49ed74 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:23.188916 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-65691e1d-4040-427e-9471-c4e8ba49ed74 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:23.196613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-65691e1d-4040-427e-9471-c4e8ba49ed74 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:23.197071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-65691e1d-4040-427e-9471-c4e8ba49ed74 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:23.197843 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-65691e1d-4040-427e-9471-c4e8ba49ed74 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:23.198283 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-65691e1d-4040-427e-9471-c4e8ba49ed74 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:23.355505 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-65691e1d-4040-427e-9471-c4e8ba49ed74 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:23.368653 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-65691e1d-4040-427e-9471-c4e8ba49ed74 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1737 microversion: 2.1 time: 0.184712 Jun 27 09:40:23.369669 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 294/563] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:23 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:23.838365 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-b1bca450-573c-411a-b2d6-c59a43ceac66 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:23.839053 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-b1bca450-573c-411a-b2d6-c59a43ceac66 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:23.845682 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b1bca450-573c-411a-b2d6-c59a43ceac66 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:23.846136 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b1bca450-573c-411a-b2d6-c59a43ceac66 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:23.846939 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b1bca450-573c-411a-b2d6-c59a43ceac66 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:23.847567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b1bca450-573c-411a-b2d6-c59a43ceac66 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:23.853250 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=100 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:23.991345 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-b1bca450-573c-411a-b2d6-c59a43ceac66 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:23.998903 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-b1bca450-573c-411a-b2d6-c59a43ceac66 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1266 microversion: 2.1 time: 0.165165 Jun 27 09:40:23.999468 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 270/564] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:23 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:24.386592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-0f966d23-c81d-4cc1-803d-eb3833bf083a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:24.388747 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-0f966d23-c81d-4cc1-803d-eb3833bf083a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:24.403040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0f966d23-c81d-4cc1-803d-eb3833bf083a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:24.403500 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0f966d23-c81d-4cc1-803d-eb3833bf083a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:24.404351 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0f966d23-c81d-4cc1-803d-eb3833bf083a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:24.404801 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0f966d23-c81d-4cc1-803d-eb3833bf083a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:24.547518 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-0f966d23-c81d-4cc1-803d-eb3833bf083a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:24.555612 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-0f966d23-c81d-4cc1-803d-eb3833bf083a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1737 microversion: 2.1 time: 0.173425 Jun 27 09:40:24.565324 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 295/565] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:24 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:25.015963 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-eb2e55e0-b222-457d-acc8-89a20e78ea9d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:25.016573 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-eb2e55e0-b222-457d-acc8-89a20e78ea9d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:25.023971 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-eb2e55e0-b222-457d-acc8-89a20e78ea9d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:25.024427 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-eb2e55e0-b222-457d-acc8-89a20e78ea9d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:25.025199 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-eb2e55e0-b222-457d-acc8-89a20e78ea9d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:25.025639 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-eb2e55e0-b222-457d-acc8-89a20e78ea9d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:25.159389 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-eb2e55e0-b222-457d-acc8-89a20e78ea9d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:25.167707 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-eb2e55e0-b222-457d-acc8-89a20e78ea9d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1266 microversion: 2.1 time: 0.155503 Jun 27 09:40:25.168278 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 271/566] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:25 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:25.573335 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-4cfd9e1d-c107-4ed8-b493-c63522d4376d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:25.573951 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-4cfd9e1d-c107-4ed8-b493-c63522d4376d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:25.580427 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4cfd9e1d-c107-4ed8-b493-c63522d4376d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:25.580880 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4cfd9e1d-c107-4ed8-b493-c63522d4376d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:25.581647 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4cfd9e1d-c107-4ed8-b493-c63522d4376d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:25.582083 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4cfd9e1d-c107-4ed8-b493-c63522d4376d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:25.707622 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4cfd9e1d-c107-4ed8-b493-c63522d4376d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:25.715445 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-4cfd9e1d-c107-4ed8-b493-c63522d4376d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1737 microversion: 2.1 time: 0.146560 Jun 27 09:40:25.716087 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 296/567] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:25 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:26.185448 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-22184bb6-87d3-425d-8989-b8f4f68635b8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:26.185988 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-22184bb6-87d3-425d-8989-b8f4f68635b8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:26.192471 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-22184bb6-87d3-425d-8989-b8f4f68635b8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:26.192919 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-22184bb6-87d3-425d-8989-b8f4f68635b8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:26.193677 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-22184bb6-87d3-425d-8989-b8f4f68635b8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:26.194111 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-22184bb6-87d3-425d-8989-b8f4f68635b8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:26.326193 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-22184bb6-87d3-425d-8989-b8f4f68635b8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:26.333703 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-22184bb6-87d3-425d-8989-b8f4f68635b8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1452 microversion: 2.1 time: 0.152193 Jun 27 09:40:26.334269 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 272/568] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:26 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:26.350618 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-552372e9-b680-46e7-9fe3-b65620f529f0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:26.351835 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-552372e9-b680-46e7-9fe3-b65620f529f0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:26.358054 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-552372e9-b680-46e7-9fe3-b65620f529f0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:26.358633 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-552372e9-b680-46e7-9fe3-b65620f529f0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:26.359358 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-552372e9-b680-46e7-9fe3-b65620f529f0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:26.359843 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-552372e9-b680-46e7-9fe3-b65620f529f0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:26.362575 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:26.493582 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-552372e9-b680-46e7-9fe3-b65620f529f0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:26.500939 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-552372e9-b680-46e7-9fe3-b65620f529f0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1452 microversion: 2.1 time: 0.154192 Jun 27 09:40:26.501574 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 297/569] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:26 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:26.732476 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-5bc720de-533a-46b9-aae7-cb048f5e2daf tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:26.733088 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-5bc720de-533a-46b9-aae7-cb048f5e2daf tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:26.738926 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5bc720de-533a-46b9-aae7-cb048f5e2daf tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:26.739376 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5bc720de-533a-46b9-aae7-cb048f5e2daf tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:26.740180 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5bc720de-533a-46b9-aae7-cb048f5e2daf tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:26.740614 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5bc720de-533a-46b9-aae7-cb048f5e2daf tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:26.961649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-5bc720de-533a-46b9-aae7-cb048f5e2daf tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:26.969904 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-5bc720de-533a-46b9-aae7-cb048f5e2daf tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1737 microversion: 2.1 time: 0.241273 Jun 27 09:40:26.970475 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 273/570] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:26 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:27.987168 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-87c6c6fc-b76a-4ead-a7a1-9e358c97390a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:27.987913 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-87c6c6fc-b76a-4ead-a7a1-9e358c97390a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:27.995162 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-87c6c6fc-b76a-4ead-a7a1-9e358c97390a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:27.995782 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-87c6c6fc-b76a-4ead-a7a1-9e358c97390a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:27.996724 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-87c6c6fc-b76a-4ead-a7a1-9e358c97390a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:27.997223 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-87c6c6fc-b76a-4ead-a7a1-9e358c97390a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:28.134125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-87c6c6fc-b76a-4ead-a7a1-9e358c97390a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:28.152627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-87c6c6fc-b76a-4ead-a7a1-9e358c97390a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1737 microversion: 2.1 time: 0.169508 Jun 27 09:40:28.155583 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 298/571] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:27 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:28.686470 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-cfcb311e-19d5-4e35-89e6-e7b1f7746d0a req-b471f0c5-c3dd-4cbc-8c1f-c1ae1d4bec55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cb9074b-9ac1-4780-ab45-dde1641b83e3", "tag": "6668e5f8-1a3b-4d07-a99b-2feabc1b8262"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:40:28.700384 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-cfcb311e-19d5-4e35-89e6-e7b1f7746d0a req-b471f0c5-c3dd-4cbc-8c1f-c1ae1d4bec55 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:28.701155 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-cfcb311e-19d5-4e35-89e6-e7b1f7746d0a req-b471f0c5-c3dd-4cbc-8c1f-c1ae1d4bec55 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:28.715197 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-cfcb311e-19d5-4e35-89e6-e7b1f7746d0a req-b471f0c5-c3dd-4cbc-8c1f-c1ae1d4bec55 service nova] Creating event network-changed:6668e5f8-1a3b-4d07-a99b-2feabc1b8262 for instance 3cb9074b-9ac1-4780-ab45-dde1641b83e3 on hv-cinder-84773 Jun 27 09:40:28.722434 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-cfcb311e-19d5-4e35-89e6-e7b1f7746d0a req-b471f0c5-c3dd-4cbc-8c1f-c1ae1d4bec55 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044258 Jun 27 09:40:28.725271 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 274/572] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:40:29.170489 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-93f1258a-f3c5-4fba-8667-09e17fa2cbcd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:29.171721 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-93f1258a-f3c5-4fba-8667-09e17fa2cbcd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:29.178788 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-93f1258a-f3c5-4fba-8667-09e17fa2cbcd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:29.179480 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-93f1258a-f3c5-4fba-8667-09e17fa2cbcd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:29.180443 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-93f1258a-f3c5-4fba-8667-09e17fa2cbcd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:29.181083 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-93f1258a-f3c5-4fba-8667-09e17fa2cbcd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:29.337414 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-93f1258a-f3c5-4fba-8667-09e17fa2cbcd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:29.345636 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-93f1258a-f3c5-4fba-8667-09e17fa2cbcd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1737 microversion: 2.1 time: 0.179197 Jun 27 09:40:29.356700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 299/573] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:29 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:30.364979 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a3ac661a-8c65-47a5-8d16-3601ab624f9b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:30.365680 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-a3ac661a-8c65-47a5-8d16-3601ab624f9b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:30.368250 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:30.373250 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a3ac661a-8c65-47a5-8d16-3601ab624f9b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:30.373705 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a3ac661a-8c65-47a5-8d16-3601ab624f9b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:30.374474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a3ac661a-8c65-47a5-8d16-3601ab624f9b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:30.374915 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a3ac661a-8c65-47a5-8d16-3601ab624f9b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:30.574829 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a3ac661a-8c65-47a5-8d16-3601ab624f9b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:30.583067 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-a3ac661a-8c65-47a5-8d16-3601ab624f9b tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1737 microversion: 2.1 time: 0.223002 Jun 27 09:40:30.583999 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 275/574] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:30 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1737 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:31.600802 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-1c25ed26-56b5-4095-80a7-27650522d858 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:31.601414 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-1c25ed26-56b5-4095-80a7-27650522d858 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:31.603857 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=54 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:31.608573 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1c25ed26-56b5-4095-80a7-27650522d858 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:31.609027 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1c25ed26-56b5-4095-80a7-27650522d858 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:31.609803 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1c25ed26-56b5-4095-80a7-27650522d858 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:31.610286 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1c25ed26-56b5-4095-80a7-27650522d858 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:31.741000 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-1c25ed26-56b5-4095-80a7-27650522d858 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:31.749502 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-1c25ed26-56b5-4095-80a7-27650522d858 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1737 microversion: 2.1 time: 0.152557 Jun 27 09:40:31.750066 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 300/575] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:31 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:32.766066 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-6a3aa30d-e859-4c1d-bd13-8a95e04b3d38 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:32.766672 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-6a3aa30d-e859-4c1d-bd13-8a95e04b3d38 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:32.773276 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6a3aa30d-e859-4c1d-bd13-8a95e04b3d38 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:32.773740 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6a3aa30d-e859-4c1d-bd13-8a95e04b3d38 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:32.774561 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6a3aa30d-e859-4c1d-bd13-8a95e04b3d38 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:32.775009 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6a3aa30d-e859-4c1d-bd13-8a95e04b3d38 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:33.141175 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-6a3aa30d-e859-4c1d-bd13-8a95e04b3d38 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:33.149075 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-6a3aa30d-e859-4c1d-bd13-8a95e04b3d38 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1717 microversion: 2.1 time: 0.386861 Jun 27 09:40:33.149633 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 276/576] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:32 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1717 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:33.250718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-207433c6-5a67-4189-8da5-0f04ba21b9e1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:33.251210 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-207433c6-5a67-4189-8da5-0f04ba21b9e1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:33.257660 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-207433c6-5a67-4189-8da5-0f04ba21b9e1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:33.258121 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-207433c6-5a67-4189-8da5-0f04ba21b9e1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:33.258885 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-207433c6-5a67-4189-8da5-0f04ba21b9e1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:33.259318 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-207433c6-5a67-4189-8da5-0f04ba21b9e1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:33.382022 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-207433c6-5a67-4189-8da5-0f04ba21b9e1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] HTTP exception thrown: Cannot 'detach_volume' instance bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 while it is in vm_state rescued Jun 27 09:40:33.383659 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-207433c6-5a67-4189-8da5-0f04ba21b9e1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Request method failure captured: Jun 27 09:40:33.383659 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: DELETE /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3/os-volume_attachments/8dd4a5f5-3f56-4b91-9544-ecb781fa03fe HTTP/1.1 Jun 27 09:40:33.383659 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:40:33.383659 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:40:33.383659 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:40:33.383659 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:40:33.383659 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:40:33.383659 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:40:33.383659 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:40:33.383659 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:40:33.383659 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXoPyTpqQqQHvEElWGjR7DZfAmEwMaudWgOazSbx2lM_fxgthBdxySIgz7_EK2myInpHOrYmO4EeBjzzrfGUjrdY5JcAdZnmqsf8z8_6nkg-QB70l4Rpm-gz_ByA_m8spfp5LU3dJlIbE7yw9ImfGdmloDzbo3Xb15bpRLxuPuS5CEY Jun 27 09:40:33.383659 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:40:33.383659 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:40:33.383659 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:40:33.383659 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:40:33.383659 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:40:33.383659 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:40:33.383659 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: 6a50c1d09d3247728aa1ef9fb69463fc Jun 27 09:40:33.383659 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1711375648 Jun 27 09:40:33.383659 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:40:33.383659 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:40:33.385095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a50c1d09d3247728aa1ef9fb69463fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a50c1d09d3247728aa1ef9fb69463fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6a50c1d09d3247728aa1ef9fb69463fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6a50c1d09d3247728aa1ef9fb69463fc", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:40:33.385095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1711375648 Jun 27 09:40:33.385095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: 6a50c1d09d3247728aa1ef9fb69463fc Jun 27 09:40:33.385095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1711375648 Jun 27 09:40:33.385095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-ServerRescueNegativeTestJSON-1711375648-project Jun 27 09:40:33.385095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:40:33.385095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:40:33.385095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: 41ce5cc7ff504d64aac73e48097a4b01 Jun 27 09:40:33.385095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1711375648-project Jun 27 09:40:33.385095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: > Jun 27 09:40:33.385095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Cannot 'detach_volume' instance bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 while it is in vm_state rescued Jun 27 09:40:33.385827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'server_id': 'bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3', 'id': '8dd4a5f5-3f56-4b91-9544-ecb781fa03fe'} Jun 27 09:40:33.385827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:40:33.385827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:40:33.385827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 27 09:40:33.385827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 27 09:40:33.385827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 09:40:33.385827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 09:40:33.385827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 27 09:40:33.385827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 27 09:40:33.385827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 27 09:40:33.385827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:40:33.385827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:40:33.385827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:40:33.385827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:40:33.385827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:40:33.385827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:40:33.385827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:40:33.385827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:40:33.385827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:40:33.385827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:40:33.387309 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 27 09:40:33.387309 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 27 09:40:33.387309 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 27 09:40:33.387309 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 27 09:40:33.387309 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 while it is in vm_state rescued Jun 27 09:40:33.387309 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:40:33.387309 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:40:33.387309 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:40:33.387309 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:40:33.387309 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:40:33.387309 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:40:33.387309 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:40:33.387309 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:40:33.387309 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 while it is in vm_state rescued Jun 27 09:40:33.387309 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:40:33.387309 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-207433c6-5a67-4189-8da5-0f04ba21b9e1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Returning 409 to user: Cannot 'detach_volume' instance bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 while it is in vm_state rescued {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:40:33.388526 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-207433c6-5a67-4189-8da5-0f04ba21b9e1 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "DELETE /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3/os-volume_attachments/8dd4a5f5-3f56-4b91-9544-ecb781fa03fe" status: 409 len: 152 microversion: 2.1 time: 0.138292 Jun 27 09:40:33.388526 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 301/577] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jun 27 09:40:33 2022] DELETE /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3/os-volume_attachments/8dd4a5f5-3f56-4b91-9544-ecb781fa03fe => generated 152 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 27 09:40:33.394002 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-9ead9e99-5bc6-4b2a-9f1d-63f6b68ff32a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:40:33.394531 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-9ead9e99-5bc6-4b2a-9f1d-63f6b68ff32a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:33.400434 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9ead9e99-5bc6-4b2a-9f1d-63f6b68ff32a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:33.400877 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9ead9e99-5bc6-4b2a-9f1d-63f6b68ff32a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:33.401633 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9ead9e99-5bc6-4b2a-9f1d-63f6b68ff32a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:33.402065 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9ead9e99-5bc6-4b2a-9f1d-63f6b68ff32a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:33.608084 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-9ead9e99-5bc6-4b2a-9f1d-63f6b68ff32a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "POST /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3/action" status: 202 len: 0 microversion: 2.1 time: 0.216320 Jun 27 09:40:33.608084 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 277/578] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 27 09:40:33 2022] POST /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:40:33.615576 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-7b2c3ba0-47b2-458d-9152-5087dc5771a9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:33.616189 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-7b2c3ba0-47b2-458d-9152-5087dc5771a9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:33.624485 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7b2c3ba0-47b2-458d-9152-5087dc5771a9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:33.624927 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7b2c3ba0-47b2-458d-9152-5087dc5771a9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:33.629900 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7b2c3ba0-47b2-458d-9152-5087dc5771a9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:33.629900 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7b2c3ba0-47b2-458d-9152-5087dc5771a9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:33.806243 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-7b2c3ba0-47b2-458d-9152-5087dc5771a9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:33.814229 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-7b2c3ba0-47b2-458d-9152-5087dc5771a9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1725 microversion: 2.1 time: 0.202527 Jun 27 09:40:33.814788 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 302/579] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:33 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:34.832332 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-fb4d47a5-f45e-4d13-ab1a-c748ceb1927a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:34.833146 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-fb4d47a5-f45e-4d13-ab1a-c748ceb1927a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:34.839304 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fb4d47a5-f45e-4d13-ab1a-c748ceb1927a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:34.839784 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fb4d47a5-f45e-4d13-ab1a-c748ceb1927a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:34.840547 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fb4d47a5-f45e-4d13-ab1a-c748ceb1927a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:34.840981 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fb4d47a5-f45e-4d13-ab1a-c748ceb1927a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:34.966740 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-fb4d47a5-f45e-4d13-ab1a-c748ceb1927a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:34.974606 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-fb4d47a5-f45e-4d13-ab1a-c748ceb1927a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1725 microversion: 2.1 time: 0.146948 Jun 27 09:40:34.975160 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 278/580] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:34 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:35.333795 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-a7fa78a8-4c46-4f63-b498-95d617b1f894 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:35.334328 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-a7fa78a8-4c46-4f63-b498-95d617b1f894 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:35.340928 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a7fa78a8-4c46-4f63-b498-95d617b1f894 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:35.341378 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a7fa78a8-4c46-4f63-b498-95d617b1f894 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:35.342134 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a7fa78a8-4c46-4f63-b498-95d617b1f894 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:35.342572 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a7fa78a8-4c46-4f63-b498-95d617b1f894 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:35.370731 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-a7fa78a8-4c46-4f63-b498-95d617b1f894 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a/os-volume_attachments/e10005c3-859a-4af5-b201-5b90e6813df5" status: 200 len: 194 microversion: 2.20 time: 0.041061 Jun 27 09:40:35.371289 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 303/581] 10.222.0.64 () {60 vars in 1453 bytes} [Mon Jun 27 09:40:35 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a/os-volume_attachments/e10005c3-859a-4af5-b201-5b90e6813df5 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 09:40:35.432496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-2358fcca-e975-42d3-a66f-f192b9bcdb89 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:35.432989 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-2358fcca-e975-42d3-a66f-f192b9bcdb89 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:35.438905 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2358fcca-e975-42d3-a66f-f192b9bcdb89 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:35.439347 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2358fcca-e975-42d3-a66f-f192b9bcdb89 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:35.440141 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2358fcca-e975-42d3-a66f-f192b9bcdb89 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:35.440577 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2358fcca-e975-42d3-a66f-f192b9bcdb89 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:35.560764 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.objects.instance [None req-2358fcca-e975-42d3-a66f-f192b9bcdb89 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lazy-loading 'services' on Instance uuid 1d72055f-6915-43b5-9831-61c2f134e60a {{(pid=124870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:40:35.864302 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-2358fcca-e975-42d3-a66f-f192b9bcdb89 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a/os-volume_attachments/e10005c3-859a-4af5-b201-5b90e6813df5" status: 202 len: 0 microversion: 2.20 time: 0.435325 Jun 27 09:40:35.867198 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 279/582] 10.222.0.64 () {60 vars in 1456 bytes} [Mon Jun 27 09:40:35 2022] DELETE /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a/os-volume_attachments/e10005c3-859a-4af5-b201-5b90e6813df5 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 09:40:35.873856 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-59f08c82-34d0-4997-8779-8c771ee544cb tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:35.874962 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-59f08c82-34d0-4997-8779-8c771ee544cb tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:35.881095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-59f08c82-34d0-4997-8779-8c771ee544cb tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:35.881545 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-59f08c82-34d0-4997-8779-8c771ee544cb tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:35.883092 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-59f08c82-34d0-4997-8779-8c771ee544cb tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:35.883552 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-59f08c82-34d0-4997-8779-8c771ee544cb tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:35.912653 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-59f08c82-34d0-4997-8779-8c771ee544cb tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042884 Jun 27 09:40:35.913194 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 304/583] 10.222.0.64 () {60 vars in 1342 bytes} [Mon Jun 27 09:40:35 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 09:40:35.993437 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-1e003774-79ef-4cba-b13c-307f7f91f2d9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:35.994200 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-1e003774-79ef-4cba-b13c-307f7f91f2d9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:36.000714 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1e003774-79ef-4cba-b13c-307f7f91f2d9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:36.001171 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1e003774-79ef-4cba-b13c-307f7f91f2d9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:36.001966 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1e003774-79ef-4cba-b13c-307f7f91f2d9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:36.002404 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1e003774-79ef-4cba-b13c-307f7f91f2d9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:36.138956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-1e003774-79ef-4cba-b13c-307f7f91f2d9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:36.147040 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-1e003774-79ef-4cba-b13c-307f7f91f2d9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1725 microversion: 2.1 time: 0.158282 Jun 27 09:40:36.147621 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 280/584] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:35 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:36.924664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-88c1ea79-3444-4329-9f80-97328e8043f8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:36.925643 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-88c1ea79-3444-4329-9f80-97328e8043f8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:36.932111 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-88c1ea79-3444-4329-9f80-97328e8043f8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:36.932566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-88c1ea79-3444-4329-9f80-97328e8043f8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:36.933330 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-88c1ea79-3444-4329-9f80-97328e8043f8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:36.933767 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-88c1ea79-3444-4329-9f80-97328e8043f8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:36.962807 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-88c1ea79-3444-4329-9f80-97328e8043f8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042117 Jun 27 09:40:36.963346 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 305/585] 10.222.0.64 () {60 vars in 1342 bytes} [Mon Jun 27 09:40:36 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 09:40:37.164263 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-434bad59-6c60-447f-896e-aec43c943a22 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:37.164879 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-434bad59-6c60-447f-896e-aec43c943a22 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:37.171707 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-434bad59-6c60-447f-896e-aec43c943a22 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:37.172230 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-434bad59-6c60-447f-896e-aec43c943a22 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:37.173022 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-434bad59-6c60-447f-896e-aec43c943a22 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:37.173465 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-434bad59-6c60-447f-896e-aec43c943a22 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:37.301980 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-434bad59-6c60-447f-896e-aec43c943a22 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:37.310843 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-434bad59-6c60-447f-896e-aec43c943a22 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1731 microversion: 2.1 time: 0.150476 Jun 27 09:40:37.311410 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 281/586] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:37 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:37.328163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-20e9c556-c1c3-414d-9850-1ec27644cb9d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:37.328729 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-20e9c556-c1c3-414d-9850-1ec27644cb9d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:37.334963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-20e9c556-c1c3-414d-9850-1ec27644cb9d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:37.335430 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-20e9c556-c1c3-414d-9850-1ec27644cb9d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:37.336229 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-20e9c556-c1c3-414d-9850-1ec27644cb9d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:37.336670 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-20e9c556-c1c3-414d-9850-1ec27644cb9d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:37.411795 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-20e9c556-c1c3-414d-9850-1ec27644cb9d tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087417 Jun 27 09:40:37.412370 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 306/587] 10.222.0.64 () {58 vars in 1274 bytes} [Mon Jun 27 09:40:37 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:40:37.973623 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-7946fb8d-4710-495d-9c83-0d090e6e381b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:37.974758 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-7946fb8d-4710-495d-9c83-0d090e6e381b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:37.981447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7946fb8d-4710-495d-9c83-0d090e6e381b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:37.981890 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7946fb8d-4710-495d-9c83-0d090e6e381b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:37.982647 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7946fb8d-4710-495d-9c83-0d090e6e381b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:37.983123 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7946fb8d-4710-495d-9c83-0d090e6e381b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:38.011984 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-7946fb8d-4710-495d-9c83-0d090e6e381b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042312 Jun 27 09:40:38.012529 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 282/588] 10.222.0.64 () {60 vars in 1342 bytes} [Mon Jun 27 09:40:37 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:40:38.071174 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-51d9c734-54ab-4de5-bf45-187af42130f5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:38.072005 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-51d9c734-54ab-4de5-bf45-187af42130f5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:38.077789 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-51d9c734-54ab-4de5-bf45-187af42130f5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:38.078243 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-51d9c734-54ab-4de5-bf45-187af42130f5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:38.079050 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-51d9c734-54ab-4de5-bf45-187af42130f5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:38.079495 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-51d9c734-54ab-4de5-bf45-187af42130f5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:38.105371 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-51d9c734-54ab-4de5-bf45-187af42130f5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Going to try to terminate instance {{(pid=124869) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 09:40:38.306719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-89470ce4-ab9d-42cd-af24-15d4c9199a2c req-e4eb7baa-254f-4bb4-b6a2-7fed9362e381 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3", "tag": "b082c8ad-e4de-4a60-b4fe-8c92c80f4c32"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:40:38.316528 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-89470ce4-ab9d-42cd-af24-15d4c9199a2c req-e4eb7baa-254f-4bb4-b6a2-7fed9362e381 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:38.323497 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-89470ce4-ab9d-42cd-af24-15d4c9199a2c req-e4eb7baa-254f-4bb4-b6a2-7fed9362e381 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:38.330240 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-89470ce4-ab9d-42cd-af24-15d4c9199a2c req-e4eb7baa-254f-4bb4-b6a2-7fed9362e381 service nova] Creating event network-changed:b082c8ad-e4de-4a60-b4fe-8c92c80f4c32 for instance bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 on hv-cinder-84773 Jun 27 09:40:38.339923 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-89470ce4-ab9d-42cd-af24-15d4c9199a2c req-e4eb7baa-254f-4bb4-b6a2-7fed9362e381 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036618 Jun 27 09:40:38.340715 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 283/589] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:40:38.431866 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-51d9c734-54ab-4de5-bf45-187af42130f5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 204 len: 0 microversion: 2.20 time: 0.364719 Jun 27 09:40:38.432469 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 307/590] 10.222.0.64 () {60 vars in 1279 bytes} [Mon Jun 27 09:40:38 2022] DELETE /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 27 09:40:38.441558 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-75c66596-5be8-4d42-a6cc-7d642cd4ee55 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:38.442514 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-75c66596-5be8-4d42-a6cc-7d642cd4ee55 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:38.449581 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-75c66596-5be8-4d42-a6cc-7d642cd4ee55 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:38.450034 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-75c66596-5be8-4d42-a6cc-7d642cd4ee55 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:38.450990 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-75c66596-5be8-4d42-a6cc-7d642cd4ee55 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:38.451431 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-75c66596-5be8-4d42-a6cc-7d642cd4ee55 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:38.583383 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-75c66596-5be8-4d42-a6cc-7d642cd4ee55 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:38.592547 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-75c66596-5be8-4d42-a6cc-7d642cd4ee55 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:38.594837 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-75c66596-5be8-4d42-a6cc-7d642cd4ee55 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:38.595401 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-75c66596-5be8-4d42-a6cc-7d642cd4ee55 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1723 microversion: 2.20 time: 0.158473 Jun 27 09:40:38.595978 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 284/591] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:40:38 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:40:39.614680 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-7a92da78-36d3-4c3c-8f1f-06e863128c71 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:39.615378 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-7a92da78-36d3-4c3c-8f1f-06e863128c71 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:39.622141 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7a92da78-36d3-4c3c-8f1f-06e863128c71 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:39.622605 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7a92da78-36d3-4c3c-8f1f-06e863128c71 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:39.623372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7a92da78-36d3-4c3c-8f1f-06e863128c71 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:39.623853 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7a92da78-36d3-4c3c-8f1f-06e863128c71 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:39.751972 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-7a92da78-36d3-4c3c-8f1f-06e863128c71 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:39.759703 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-7a92da78-36d3-4c3c-8f1f-06e863128c71 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:39.761199 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-7a92da78-36d3-4c3c-8f1f-06e863128c71 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:39.762340 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-7a92da78-36d3-4c3c-8f1f-06e863128c71 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1723 microversion: 2.20 time: 0.151934 Jun 27 09:40:39.762924 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 308/592] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:40:39 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:40:40.376651 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-1d99e4ab-a4cb-4bb9-ab35-1eec6cf7b58c req-47b5c5d0-1e9e-42f1-bbb2-c28e8a653aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3", "tag": "b082c8ad-e4de-4a60-b4fe-8c92c80f4c32"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:40:40.385844 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-1d99e4ab-a4cb-4bb9-ab35-1eec6cf7b58c req-47b5c5d0-1e9e-42f1-bbb2-c28e8a653aa4 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:40.386289 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-1d99e4ab-a4cb-4bb9-ab35-1eec6cf7b58c req-47b5c5d0-1e9e-42f1-bbb2-c28e8a653aa4 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:40.397009 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-1d99e4ab-a4cb-4bb9-ab35-1eec6cf7b58c req-47b5c5d0-1e9e-42f1-bbb2-c28e8a653aa4 service nova] Creating event network-changed:b082c8ad-e4de-4a60-b4fe-8c92c80f4c32 for instance bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 on hv-cinder-84773 Jun 27 09:40:40.401859 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-1d99e4ab-a4cb-4bb9-ab35-1eec6cf7b58c req-47b5c5d0-1e9e-42f1-bbb2-c28e8a653aa4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028958 Jun 27 09:40:40.402591 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 285/593] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:40:40.782432 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-89440a93-79da-4ab4-a48e-719a364b296a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:40.783780 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-89440a93-79da-4ab4-a48e-719a364b296a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:40.790569 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-89440a93-79da-4ab4-a48e-719a364b296a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:40.793658 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-89440a93-79da-4ab4-a48e-719a364b296a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:40.793658 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-89440a93-79da-4ab4-a48e-719a364b296a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:40.793658 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-89440a93-79da-4ab4-a48e-719a364b296a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:41.029553 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-89440a93-79da-4ab4-a48e-719a364b296a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:41.037893 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-89440a93-79da-4ab4-a48e-719a364b296a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:41.040112 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-89440a93-79da-4ab4-a48e-719a364b296a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:41.041271 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-89440a93-79da-4ab4-a48e-719a364b296a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1723 microversion: 2.20 time: 0.263247 Jun 27 09:40:41.042095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 309/594] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:40:40 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:40:41.423985 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-849b15f0-9f27-49dd-b0a6-7e52b8783941 req-259b1ea9-a6fd-4127-9294-fef6b0ffec21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d72055f-6915-43b5-9831-61c2f134e60a", "name": "network-vif-deleted", "tag": "a233eb88-dce4-49a8-9bf9-7a59a86e981b"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:40:41.432984 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-849b15f0-9f27-49dd-b0a6-7e52b8783941 req-259b1ea9-a6fd-4127-9294-fef6b0ffec21 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:41.433704 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-849b15f0-9f27-49dd-b0a6-7e52b8783941 req-259b1ea9-a6fd-4127-9294-fef6b0ffec21 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:41.445117 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-849b15f0-9f27-49dd-b0a6-7e52b8783941 req-259b1ea9-a6fd-4127-9294-fef6b0ffec21 service nova] Creating event network-vif-deleted:a233eb88-dce4-49a8-9bf9-7a59a86e981b for instance 1d72055f-6915-43b5-9831-61c2f134e60a on hv-cinder-84773 Jun 27 09:40:41.450641 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-849b15f0-9f27-49dd-b0a6-7e52b8783941 req-259b1ea9-a6fd-4127-9294-fef6b0ffec21 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031544 Jun 27 09:40:41.451245 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 286/595] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:40:42.060235 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-1b83d044-482f-4b9e-91b9-84334450e6b1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:42.060845 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-1b83d044-482f-4b9e-91b9-84334450e6b1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:42.070070 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1b83d044-482f-4b9e-91b9-84334450e6b1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:42.071238 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1b83d044-482f-4b9e-91b9-84334450e6b1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:42.072045 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1b83d044-482f-4b9e-91b9-84334450e6b1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:42.072483 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1b83d044-482f-4b9e-91b9-84334450e6b1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:42.105496 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1b83d044-482f-4b9e-91b9-84334450e6b1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:42.105938 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1b83d044-482f-4b9e-91b9-84334450e6b1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:42.106393 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.objects.instance [None req-1b83d044-482f-4b9e-91b9-84334450e6b1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lazy-loading 'fault' on Instance uuid 1d72055f-6915-43b5-9831-61c2f134e60a {{(pid=124869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:40:42.151741 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-1b83d044-482f-4b9e-91b9-84334450e6b1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:42.159984 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-1b83d044-482f-4b9e-91b9-84334450e6b1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:42.161608 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-1b83d044-482f-4b9e-91b9-84334450e6b1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:42.162756 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-1b83d044-482f-4b9e-91b9-84334450e6b1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 200 len: 1371 microversion: 2.20 time: 0.106534 Jun 27 09:40:42.163688 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 310/596] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:40:42 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:40:43.183368 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-04b0d69d-0d54-4336-91b5-a39c1075ba4f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:43.184193 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-04b0d69d-0d54-4336-91b5-a39c1075ba4f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:43.190659 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-04b0d69d-0d54-4336-91b5-a39c1075ba4f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:43.191096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-04b0d69d-0d54-4336-91b5-a39c1075ba4f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:43.191910 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-04b0d69d-0d54-4336-91b5-a39c1075ba4f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:43.192352 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-04b0d69d-0d54-4336-91b5-a39c1075ba4f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:43.207017 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-04b0d69d-0d54-4336-91b5-a39c1075ba4f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] HTTP exception thrown: Instance 1d72055f-6915-43b5-9831-61c2f134e60a could not be found. Jun 27 09:40:43.208712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-04b0d69d-0d54-4336-91b5-a39c1075ba4f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Request method failure captured: Jun 27 09:40:43.208712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a HTTP/1.1 Jun 27 09:40:43.208712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:40:43.208712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:40:43.208712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:40:43.208712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:40:43.208712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:40:43.208712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:40:43.208712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:40:43.208712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:40:43.208712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXoJJ2on-vFvBN2hd8yLxFr4nVegprkoLqLkEWYwqvIslCEL7vsWnTBx7IO8PucStJDzd62-rrayKwqbZ1ocA321ZRnm_fBun99fzI6XjdKZFsSRzGUyPIn3uZ-BksjvZ0mRBGq4ePsoGmkGL3igk6m8swuGg-D3dqSjleQ3MXdBjHw Jun 27 09:40:43.208712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:40:43.208712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:40:43.208712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:40:43.208712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:40:43.208712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 09:40:43.208712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:40:43.208712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:40:43.208712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: 79203b0660c041f49c5f2629bd5a0bdf Jun 27 09:40:43.208712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-130800964 Jun 27 09:40:43.208712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:40:43.208712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:40:43.210156 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/79203b0660c041f49c5f2629bd5a0bdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/79203b0660c041f49c5f2629bd5a0bdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/79203b0660c041f49c5f2629bd5a0bdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_79203b0660c041f49c5f2629bd5a0bdf", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:40:43.210156 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-AttachVolumeShelveTestJSON-130800964 Jun 27 09:40:43.210156 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: 79203b0660c041f49c5f2629bd5a0bdf Jun 27 09:40:43.210156 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-130800964 Jun 27 09:40:43.210156 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-AttachVolumeShelveTestJSON-130800964-project Jun 27 09:40:43.210156 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:40:43.210156 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:40:43.210156 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: ecf085030e8e4a65a7140fea2b64a7ed Jun 27 09:40:43.210156 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-AttachVolumeShelveTestJSON-130800964-project Jun 27 09:40:43.210156 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: > Jun 27 09:40:43.210156 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Instance 1d72055f-6915-43b5-9831-61c2f134e60a could not be found. Jun 27 09:40:43.210156 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': '1d72055f-6915-43b5-9831-61c2f134e60a'} Jun 27 09:40:43.211096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:40:43.211096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:40:43.211096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:40:43.211096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:40:43.211096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:40:43.211096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:40:43.211096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:40:43.211096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:40:43.211096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:40:43.211096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:40:43.211096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d72055f-6915-43b5-9831-61c2f134e60a could not be found. Jun 27 09:40:43.211096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:40:43.211096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:40:43.211096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:40:43.211096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:40:43.211096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:40:43.211096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:40:43.211096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:40:43.211096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:40:43.211096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:40:43.213778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:40:43.213778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:40:43.213778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:40:43.213778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:40:43.213778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:40:43.213778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:40:43.213778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:40:43.213778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d72055f-6915-43b5-9831-61c2f134e60a could not be found. Jun 27 09:40:43.213778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:40:43.213778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:40:43.213778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:40:43.213778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:40:43.213778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:40:43.213778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:40:43.213778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:40:43.213778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:40:43.213778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d72055f-6915-43b5-9831-61c2f134e60a could not be found. Jun 27 09:40:43.213778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:40:43.216050 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-04b0d69d-0d54-4336-91b5-a39c1075ba4f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Returning 404 to user: Instance 1d72055f-6915-43b5-9831-61c2f134e60a could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:40:43.216050 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-04b0d69d-0d54-4336-91b5-a39c1075ba4f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 404 len: 111 microversion: 2.20 time: 0.031567 Jun 27 09:40:43.216050 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 287/597] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:40:43 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 09:40:43.219725 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-d4d2f999-2d0a-4ae2-a95f-482982e79c63 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '.version_select at 0x7ffa9747fe50>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:43.295737 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-d4d2f999-2d0a-4ae2-a95f-482982e79c63 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1478563327" status: 204 len: 0 microversion: 2.20 time: 0.079761 Jun 27 09:40:43.296330 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 311/598] 10.222.0.64 () {60 vars in 1261 bytes} [Mon Jun 27 09:40:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1478563327 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 27 09:40:44.047593 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-2e1cf313-98eb-4de0-b47a-e8575d369101 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Action: 'create', calling method: .version_select at 0x7ffa97452430>, body: {"keypair": {"name": "tempest-keypair-2057933831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFzdNdGjns2zlm+P8m9mkGd+APVhRR6Bolg+QOrWpCPflFj3UvDFEiV4wzDJD6d3Bfq5V+Pgp5s0v1nUBSbI9kBsdqmeJlHOlUnFMtZvz/3JM15+lrPCE8ptaVWiSUToQ=="}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:40:44.061493 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-2e1cf313-98eb-4de0-b47a-e8575d369101 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Getting quotas for project 79203b0660c041f49c5f2629bd5a0bdf. Resources: {'key_pairs'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:40:44.065365 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-2e1cf313-98eb-4de0-b47a-e8575d369101 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Getting quotas for user ecf085030e8e4a65a7140fea2b64a7ed and project 79203b0660c041f49c5f2629bd5a0bdf. Resources: {'key_pairs'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:40:44.146820 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-2e1cf313-98eb-4de0-b47a-e8575d369101 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.102908 Jun 27 09:40:44.147317 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 288/599] 10.222.0.64 () {62 vars in 1199 bytes} [Mon Jun 27 09:40:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 104 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 27 09:40:46.453146 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-fdcfeab2-079d-419d-8cf3-13e9ac1c3095 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1036191374", "imageRef": "96dfa32c-d52f-4225-8918-743ebc97f4bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7ad0500a-ea93-4b00-b42a-06ba39611c6e"}], "security_groups": [{"name": "tempest-securitygroup--1679517559"}], "key_name": "tempest-keypair-2057933831", "user_data": "}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:40:46.550080 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.network.neutron [None req-fdcfeab2-079d-419d-8cf3-13e9ac1c3095 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] validate_networks() for [('7ad0500a-ea93-4b00-b42a-06ba39611c6e', None, None, None, None, None)] {{(pid=124869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 09:40:47.130396 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-fdcfeab2-079d-419d-8cf3-13e9ac1c3095 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Flavor limits 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 09:40:47.130829 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-fdcfeab2-079d-419d-8cf3-13e9ac1c3095 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Image limits 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 09:40:47.131448 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-fdcfeab2-079d-419d-8cf3-13e9ac1c3095 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Flavor pref 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 09:40:47.131858 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-fdcfeab2-079d-419d-8cf3-13e9ac1c3095 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Image pref 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 09:40:47.132610 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-fdcfeab2-079d-419d-8cf3-13e9ac1c3095 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 09:40:47.141904 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fdcfeab2-079d-419d-8cf3-13e9ac1c3095 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:47.142352 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fdcfeab2-079d-419d-8cf3-13e9ac1c3095 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:47.143150 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fdcfeab2-079d-419d-8cf3-13e9ac1c3095 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:47.143602 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fdcfeab2-079d-419d-8cf3-13e9ac1c3095 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:47.160676 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-fdcfeab2-079d-419d-8cf3-13e9ac1c3095 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Getting quotas for project 79203b0660c041f49c5f2629bd5a0bdf. Resources: {'ram', 'instances', 'cores'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:40:47.165310 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-fdcfeab2-079d-419d-8cf3-13e9ac1c3095 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Getting quotas for user ecf085030e8e4a65a7140fea2b64a7ed and project 79203b0660c041f49c5f2629bd5a0bdf. Resources: {'ram', 'instances', 'cores'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:40:47.176412 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-fdcfeab2-079d-419d-8cf3-13e9ac1c3095 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Going to run 1 instances... {{(pid=124869) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 09:40:47.178708 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-fdcfeab2-079d-419d-8cf3-13e9ac1c3095 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96dfa32c-d52f-4225-8918-743ebc97f4bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 09:40:47.319744 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-fdcfeab2-079d-419d-8cf3-13e9ac1c3095 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.871369 Jun 27 09:40:47.320422 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 312/600] 10.222.0.64 () {62 vars in 1187 bytes} [Mon Jun 27 09:40:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 27 09:40:47.331043 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-4c6805b1-ca23-4547-b14e-46041b369985 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:47.331676 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-4c6805b1-ca23-4547-b14e-46041b369985 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:47.388068 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4c6805b1-ca23-4547-b14e-46041b369985 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:47.396120 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4c6805b1-ca23-4547-b14e-46041b369985 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:47.397614 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4c6805b1-ca23-4547-b14e-46041b369985 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:47.399262 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-4c6805b1-ca23-4547-b14e-46041b369985 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1282 microversion: 2.20 time: 0.072233 Jun 27 09:40:47.399923 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 289/601] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:40:47 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1282 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:40:48.418793 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-4a6ed04d-3cb9-441d-8d1f-9e499ae95136 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:48.419405 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-4a6ed04d-3cb9-441d-8d1f-9e499ae95136 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:48.425729 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4a6ed04d-3cb9-441d-8d1f-9e499ae95136 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:48.426181 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4a6ed04d-3cb9-441d-8d1f-9e499ae95136 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:48.426946 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4a6ed04d-3cb9-441d-8d1f-9e499ae95136 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:48.427385 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4a6ed04d-3cb9-441d-8d1f-9e499ae95136 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:48.491925 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4a6ed04d-3cb9-441d-8d1f-9e499ae95136 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:48.494254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:48.500636 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4a6ed04d-3cb9-441d-8d1f-9e499ae95136 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:48.502185 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4a6ed04d-3cb9-441d-8d1f-9e499ae95136 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:48.503281 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-4a6ed04d-3cb9-441d-8d1f-9e499ae95136 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1278 microversion: 2.20 time: 0.089815 Jun 27 09:40:48.503868 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 313/602] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:40:48 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1278 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:40:49.521123 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-f38286ee-aa8a-4850-989f-f579b1268f19 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:49.521746 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-f38286ee-aa8a-4850-989f-f579b1268f19 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:49.532045 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f38286ee-aa8a-4850-989f-f579b1268f19 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:49.532494 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f38286ee-aa8a-4850-989f-f579b1268f19 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:49.533263 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f38286ee-aa8a-4850-989f-f579b1268f19 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:49.534079 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f38286ee-aa8a-4850-989f-f579b1268f19 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:49.556607 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:49.597202 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-f38286ee-aa8a-4850-989f-f579b1268f19 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:49.605481 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-f38286ee-aa8a-4850-989f-f579b1268f19 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:49.606972 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-f38286ee-aa8a-4850-989f-f579b1268f19 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:49.608090 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-f38286ee-aa8a-4850-989f-f579b1268f19 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1352 microversion: 2.20 time: 0.091027 Jun 27 09:40:49.608635 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 290/603] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:40:49 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:40:50.218548 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-2ed81cc5-d25c-4550-93c3-b1fa82c6a2fa tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:40:50.219678 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-2ed81cc5-d25c-4550-93c3-b1fa82c6a2fa tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:50.226794 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2ed81cc5-d25c-4550-93c3-b1fa82c6a2fa tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:50.227909 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2ed81cc5-d25c-4550-93c3-b1fa82c6a2fa tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:50.228687 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2ed81cc5-d25c-4550-93c3-b1fa82c6a2fa tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:50.229182 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2ed81cc5-d25c-4550-93c3-b1fa82c6a2fa tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:50.475649 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-2ed81cc5-d25c-4550-93c3-b1fa82c6a2fa tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "POST /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129/action" status: 202 len: 0 microversion: 2.1 time: 0.261700 Jun 27 09:40:50.479310 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 314/604] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 27 09:40:50 2022] POST /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 09:40:50.484585 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-2a664544-f33b-4ac7-bacc-1a66b746e149 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:50.485284 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-2a664544-f33b-4ac7-bacc-1a66b746e149 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:50.492770 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2a664544-f33b-4ac7-bacc-1a66b746e149 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:50.493224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2a664544-f33b-4ac7-bacc-1a66b746e149 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:50.497860 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2a664544-f33b-4ac7-bacc-1a66b746e149 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:50.497860 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2a664544-f33b-4ac7-bacc-1a66b746e149 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:50.630700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e27e07b6-8879-4158-864d-bd3b59979ced tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:50.631519 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-e27e07b6-8879-4158-864d-bd3b59979ced tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:50.639914 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e27e07b6-8879-4158-864d-bd3b59979ced tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:50.639914 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e27e07b6-8879-4158-864d-bd3b59979ced tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:50.640946 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e27e07b6-8879-4158-864d-bd3b59979ced tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:50.641443 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e27e07b6-8879-4158-864d-bd3b59979ced tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:50.704647 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-2a664544-f33b-4ac7-bacc-1a66b746e149 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:50.715639 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-2a664544-f33b-4ac7-bacc-1a66b746e149 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1751 microversion: 2.1 time: 0.234027 Jun 27 09:40:50.716756 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 291/605] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:50 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1751 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:50.848691 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e27e07b6-8879-4158-864d-bd3b59979ced tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:50.858944 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e27e07b6-8879-4158-864d-bd3b59979ced tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:50.861243 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e27e07b6-8879-4158-864d-bd3b59979ced tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:50.862596 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-e27e07b6-8879-4158-864d-bd3b59979ced tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1408 microversion: 2.20 time: 0.236351 Jun 27 09:40:50.873029 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 315/606] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:40:50 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:40:50.993939 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-43350b9c-9e62-42ac-a594-af5cef938bbb req-5612f545-04e9-4e29-896a-1377ae3b3e14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "448074d1-f23d-4254-a9ec-26b00bd1298c", "tag": "55e62be6-d365-40b9-9f9d-24357beba5b2"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:40:51.003820 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-43350b9c-9e62-42ac-a594-af5cef938bbb req-5612f545-04e9-4e29-896a-1377ae3b3e14 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:51.004408 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-43350b9c-9e62-42ac-a594-af5cef938bbb req-5612f545-04e9-4e29-896a-1377ae3b3e14 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:51.019231 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-43350b9c-9e62-42ac-a594-af5cef938bbb req-5612f545-04e9-4e29-896a-1377ae3b3e14 service nova] Creating event network-changed:55e62be6-d365-40b9-9f9d-24357beba5b2 for instance 448074d1-f23d-4254-a9ec-26b00bd1298c on hv-cinder-84773 Jun 27 09:40:51.032221 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-43350b9c-9e62-42ac-a594-af5cef938bbb req-5612f545-04e9-4e29-896a-1377ae3b3e14 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042056 Jun 27 09:40:51.032830 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 292/607] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:40:51.366586 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e08bab38-3dc5-433c-8700-aae972a01cb1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:51.367137 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-e08bab38-3dc5-433c-8700-aae972a01cb1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:51.373662 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e08bab38-3dc5-433c-8700-aae972a01cb1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:51.374142 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e08bab38-3dc5-433c-8700-aae972a01cb1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:51.374903 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e08bab38-3dc5-433c-8700-aae972a01cb1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:51.375339 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e08bab38-3dc5-433c-8700-aae972a01cb1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:51.398949 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-e08bab38-3dc5-433c-8700-aae972a01cb1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde/ips" status: 200 len: 150 microversion: 2.1 time: 0.036249 Jun 27 09:40:51.400072 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 316/608] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jun 27 09:40:51 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:40:51.418274 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-b97a76b5-b700-4f22-b116-73d3e3dfd13d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73d849d8-5ad9-49fb-bef8-123399e09e06"}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:40:51.419420 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-b97a76b5-b700-4f22-b116-73d3e3dfd13d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:51.426380 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b97a76b5-b700-4f22-b116-73d3e3dfd13d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:51.426829 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b97a76b5-b700-4f22-b116-73d3e3dfd13d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:51.427634 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b97a76b5-b700-4f22-b116-73d3e3dfd13d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:51.428075 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b97a76b5-b700-4f22-b116-73d3e3dfd13d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:51.511152 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-b97a76b5-b700-4f22-b116-73d3e3dfd13d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] HTTP exception thrown: Invalid volume: volume 73d849d8-5ad9-49fb-bef8-123399e09e06 is already attached to instances: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 Jun 27 09:40:51.513128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-b97a76b5-b700-4f22-b116-73d3e3dfd13d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Request method failure captured: Jun 27 09:40:51.513128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: POST /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde/os-volume_attachments HTTP/1.1 Jun 27 09:40:51.513128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:40:51.513128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:40:51.513128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:40:51.513128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 74 Jun 27 09:40:51.513128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:40:51.513128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:40:51.513128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:40:51.513128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:40:51.513128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXpn-3iJO0jmG6cEr_seNLdcseHi8n8wEHckwmRo6ljOk7Dw2fW8MzVJsAVvtrRo6EbRwOL-ZWvD5H6s-lM4yKMyphFO-R0p3TN9KgYR5zUQQ4U5gMxDEUMuzuQRv_UTCVszqW1Rzxb7_cNEjM991nroZ5_Kz-paBsAlLj4MpU5gWgY Jun 27 09:40:51.513128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:40:51.513128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:40:51.513128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:40:51.513128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:40:51.513128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:40:51.513128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:40:51.513128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:40:51.513128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:40:51.513128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:40:51.513128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:40:51.514689 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4b698ead017b4ef8b397ee127b487309", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:40:51.514689 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:40:51.514689 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:40:51.514689 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:40:51.514689 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:40:51.514689 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:40:51.514689 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:40:51.514689 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: cc8a087e97424d2890952be33695378f Jun 27 09:40:51.514689 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:40:51.514689 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Jun 27 09:40:51.514689 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {"volumeAttachment": {"volumeId": "73d849d8-5ad9-49fb-bef8-123399e09e06"}} Jun 27 09:40:51.514689 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: > Jun 27 09:40:51.515567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Invalid volume: volume 73d849d8-5ad9-49fb-bef8-123399e09e06 is already attached to instances: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 Jun 27 09:40:51.515567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'server_id': '102adf3a-476d-4af7-8267-15e963425bde', 'body': {'volumeAttachment': {'volumeId': '73d849d8-5ad9-49fb-bef8-123399e09e06'}}} Jun 27 09:40:51.515567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:40:51.515567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:40:51.515567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 27 09:40:51.515567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 27 09:40:51.515567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 09:40:51.515567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 09:40:51.515567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 27 09:40:51.515567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 27 09:40:51.515567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 27 09:40:51.515567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 27 09:40:51.515567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 27 09:40:51.515567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 27 09:40:51.515567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 73d849d8-5ad9-49fb-bef8-123399e09e06 is already attached to instances: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 Jun 27 09:40:51.515567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:40:51.515567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:40:51.515567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:40:51.515567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:40:51.521691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:40:51.521691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:40:51.521691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:40:51.521691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:40:51.521691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:40:51.521691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:40:51.521691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 09:40:51.521691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 09:40:51.521691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 09:40:51.521691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 09:40:51.521691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 09:40:51.521691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 09:40:51.521691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 27 09:40:51.521691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 27 09:40:51.521691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 73d849d8-5ad9-49fb-bef8-123399e09e06 is already attached to instances: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 Jun 27 09:40:51.521691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:40:51.521691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:40:51.521691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:40:51.521691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:40:51.521691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:40:51.523061 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:40:51.523061 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:40:51.523061 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:40:51.523061 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 73d849d8-5ad9-49fb-bef8-123399e09e06 is already attached to instances: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 Jun 27 09:40:51.523061 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:40:51.523061 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-b97a76b5-b700-4f22-b116-73d3e3dfd13d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Returning 400 to user: Invalid volume: volume 73d849d8-5ad9-49fb-bef8-123399e09e06 is already attached to instances: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:40:51.523061 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-b97a76b5-b700-4f22-b116-73d3e3dfd13d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "POST /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101634 Jun 27 09:40:51.523061 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 293/609] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 27 09:40:51 2022] POST /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 27 09:40:51.524365 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-2072f163-7e35-45b7-a92e-093312c03688 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:51.524859 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-2072f163-7e35-45b7-a92e-093312c03688 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:51.531182 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2072f163-7e35-45b7-a92e-093312c03688 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:51.531580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2072f163-7e35-45b7-a92e-093312c03688 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:51.532547 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2072f163-7e35-45b7-a92e-093312c03688 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:51.533051 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2072f163-7e35-45b7-a92e-093312c03688 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:51.560117 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-2072f163-7e35-45b7-a92e-093312c03688 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Going to try to terminate instance {{(pid=124869) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 09:40:51.733110 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-843bcae4-8588-41b7-b7d7-025b030ff088 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:51.733880 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-843bcae4-8588-41b7-b7d7-025b030ff088 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:51.741519 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-843bcae4-8588-41b7-b7d7-025b030ff088 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:51.742110 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-843bcae4-8588-41b7-b7d7-025b030ff088 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:51.744248 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-843bcae4-8588-41b7-b7d7-025b030ff088 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:51.744815 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-843bcae4-8588-41b7-b7d7-025b030ff088 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:51.824445 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-2072f163-7e35-45b7-a92e-093312c03688 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "DELETE /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 204 len: 0 microversion: 2.1 time: 0.304457 Jun 27 09:40:51.825039 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 317/610] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:40:51 2022] DELETE /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 09:40:51.833560 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-42b7720c-d10b-40e4-ba34-0d7a741dafae tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:51.834260 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-42b7720c-d10b-40e4-ba34-0d7a741dafae tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:51.840359 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-42b7720c-d10b-40e4-ba34-0d7a741dafae tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:51.840808 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-42b7720c-d10b-40e4-ba34-0d7a741dafae tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:51.841577 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-42b7720c-d10b-40e4-ba34-0d7a741dafae tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:51.842018 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-42b7720c-d10b-40e4-ba34-0d7a741dafae tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:51.938057 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-843bcae4-8588-41b7-b7d7-025b030ff088 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:51.946063 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-843bcae4-8588-41b7-b7d7-025b030ff088 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1756 microversion: 2.1 time: 0.216928 Jun 27 09:40:51.946631 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 294/611] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:51 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1756 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:40:51.951346 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-8f03cbce-e117-434e-bfd0-ecb912c74fae tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:51.951983 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-8f03cbce-e117-434e-bfd0-ecb912c74fae tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:51.957588 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8f03cbce-e117-434e-bfd0-ecb912c74fae tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:51.958041 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8f03cbce-e117-434e-bfd0-ecb912c74fae tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:51.958799 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8f03cbce-e117-434e-bfd0-ecb912c74fae tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:51.959231 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8f03cbce-e117-434e-bfd0-ecb912c74fae tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:51.972725 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-42b7720c-d10b-40e4-ba34-0d7a741dafae tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:51.980683 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-42b7720c-d10b-40e4-ba34-0d7a741dafae tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1681 microversion: 2.1 time: 0.151218 Jun 27 09:40:51.981479 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 318/612] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:51 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:40:52.085835 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8f03cbce-e117-434e-bfd0-ecb912c74fae tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:52.093632 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8f03cbce-e117-434e-bfd0-ecb912c74fae tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:52.095127 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8f03cbce-e117-434e-bfd0-ecb912c74fae tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:52.096260 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-8f03cbce-e117-434e-bfd0-ecb912c74fae tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1408 microversion: 2.20 time: 0.148432 Jun 27 09:40:52.096805 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 295/613] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:40:51 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:40:52.964402 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-089aaeae-17d6-42ba-a984-20c5698abca9 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:52.965034 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-089aaeae-17d6-42ba-a984-20c5698abca9 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:52.971495 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-089aaeae-17d6-42ba-a984-20c5698abca9 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:52.971975 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-089aaeae-17d6-42ba-a984-20c5698abca9 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:52.972734 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-089aaeae-17d6-42ba-a984-20c5698abca9 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:52.973170 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-089aaeae-17d6-42ba-a984-20c5698abca9 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:52.997220 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-3da71d95-9e22-461b-9b0d-48be15532d15 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:52.997825 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-3da71d95-9e22-461b-9b0d-48be15532d15 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:53.004497 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3da71d95-9e22-461b-9b0d-48be15532d15 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:53.004944 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3da71d95-9e22-461b-9b0d-48be15532d15 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:53.005710 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3da71d95-9e22-461b-9b0d-48be15532d15 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:53.006150 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3da71d95-9e22-461b-9b0d-48be15532d15 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:53.119296 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-089aaeae-17d6-42ba-a984-20c5698abca9 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:53.127435 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-089aaeae-17d6-42ba-a984-20c5698abca9 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1756 microversion: 2.1 time: 0.167893 Jun 27 09:40:53.128086 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 319/614] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:52 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:53.132548 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-35dbf71d-c75c-4f7d-b9bf-573a28ef831f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:53.133196 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-35dbf71d-c75c-4f7d-b9bf-573a28ef831f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:53.139834 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-3da71d95-9e22-461b-9b0d-48be15532d15 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:53.140117 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-35dbf71d-c75c-4f7d-b9bf-573a28ef831f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:53.140562 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-35dbf71d-c75c-4f7d-b9bf-573a28ef831f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:53.141332 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-35dbf71d-c75c-4f7d-b9bf-573a28ef831f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:53.141773 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-35dbf71d-c75c-4f7d-b9bf-573a28ef831f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:53.147656 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-3da71d95-9e22-461b-9b0d-48be15532d15 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1681 microversion: 2.1 time: 0.154093 Jun 27 09:40:53.155611 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 296/615] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:52 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:40:53.273057 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-35dbf71d-c75c-4f7d-b9bf-573a28ef831f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:53.280865 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-35dbf71d-c75c-4f7d-b9bf-573a28ef831f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:53.282371 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-35dbf71d-c75c-4f7d-b9bf-573a28ef831f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:53.283516 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-35dbf71d-c75c-4f7d-b9bf-573a28ef831f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1408 microversion: 2.20 time: 0.154514 Jun 27 09:40:53.284136 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 320/616] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:40:53 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:40:54.145560 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-3e7d37bc-dcf2-4428-8876-acb7ca186a5f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:54.146176 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-3e7d37bc-dcf2-4428-8876-acb7ca186a5f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:54.153435 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3e7d37bc-dcf2-4428-8876-acb7ca186a5f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:54.153890 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3e7d37bc-dcf2-4428-8876-acb7ca186a5f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:54.154658 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3e7d37bc-dcf2-4428-8876-acb7ca186a5f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:54.155390 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3e7d37bc-dcf2-4428-8876-acb7ca186a5f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:54.164759 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-79f8e1f3-2eb2-4de3-904d-4d1c7e7204ca tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:54.165364 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-79f8e1f3-2eb2-4de3-904d-4d1c7e7204ca tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:54.171998 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-79f8e1f3-2eb2-4de3-904d-4d1c7e7204ca tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:54.172438 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-79f8e1f3-2eb2-4de3-904d-4d1c7e7204ca tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:54.173191 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-79f8e1f3-2eb2-4de3-904d-4d1c7e7204ca tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:54.173622 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-79f8e1f3-2eb2-4de3-904d-4d1c7e7204ca tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:54.300042 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-3e7d37bc-dcf2-4428-8876-acb7ca186a5f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:54.306454 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-79f8e1f3-2eb2-4de3-904d-4d1c7e7204ca tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:54.307888 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-3e7d37bc-dcf2-4428-8876-acb7ca186a5f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1756 microversion: 2.1 time: 0.166094 Jun 27 09:40:54.308646 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 297/617] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:54 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:54.312855 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e450299a-8d92-47bd-984f-9e634fcef16c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:54.313454 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e450299a-8d92-47bd-984f-9e634fcef16c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:54.314187 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-79f8e1f3-2eb2-4de3-904d-4d1c7e7204ca tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1681 microversion: 2.1 time: 0.153134 Jun 27 09:40:54.323575 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 321/618] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:54 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:40:54.323752 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e450299a-8d92-47bd-984f-9e634fcef16c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:54.323752 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e450299a-8d92-47bd-984f-9e634fcef16c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:54.323752 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e450299a-8d92-47bd-984f-9e634fcef16c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:54.323752 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e450299a-8d92-47bd-984f-9e634fcef16c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:54.455822 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-e450299a-8d92-47bd-984f-9e634fcef16c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:54.464251 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-e450299a-8d92-47bd-984f-9e634fcef16c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:54.465760 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-e450299a-8d92-47bd-984f-9e634fcef16c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:54.466871 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e450299a-8d92-47bd-984f-9e634fcef16c tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1408 microversion: 2.20 time: 0.157481 Jun 27 09:40:54.467413 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 298/619] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:40:54 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:40:55.294537 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-512b61a2-6bf5-4f90-b180-cd2d32e27d36 req-ff8492bf-9e87-4880-a084-a38650940461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "102adf3a-476d-4af7-8267-15e963425bde", "name": "network-vif-deleted", "tag": "1c045054-5e3a-4e2b-8877-18f92b60b5a0"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:40:55.303210 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-512b61a2-6bf5-4f90-b180-cd2d32e27d36 req-ff8492bf-9e87-4880-a084-a38650940461 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:55.303694 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-512b61a2-6bf5-4f90-b180-cd2d32e27d36 req-ff8492bf-9e87-4880-a084-a38650940461 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:55.316911 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-512b61a2-6bf5-4f90-b180-cd2d32e27d36 req-ff8492bf-9e87-4880-a084-a38650940461 service nova] Creating event network-vif-deleted:1c045054-5e3a-4e2b-8877-18f92b60b5a0 for instance 102adf3a-476d-4af7-8267-15e963425bde on hv-cinder-84773 Jun 27 09:40:55.322734 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-512b61a2-6bf5-4f90-b180-cd2d32e27d36 req-ff8492bf-9e87-4880-a084-a38650940461 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032109 Jun 27 09:40:55.323335 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 322/620] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:40:55.324874 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-b7310997-6c24-4a17-9de6-ee07681e27d8 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:55.326959 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-b7310997-6c24-4a17-9de6-ee07681e27d8 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:55.332250 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-610813e1-9620-4970-8b17-355326a7a4c2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:55.332963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-610813e1-9620-4970-8b17-355326a7a4c2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:55.334224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b7310997-6c24-4a17-9de6-ee07681e27d8 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:55.334832 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b7310997-6c24-4a17-9de6-ee07681e27d8 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:55.335820 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b7310997-6c24-4a17-9de6-ee07681e27d8 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:55.336447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b7310997-6c24-4a17-9de6-ee07681e27d8 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:55.340364 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-610813e1-9620-4970-8b17-355326a7a4c2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:55.340822 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-610813e1-9620-4970-8b17-355326a7a4c2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:55.341606 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-610813e1-9620-4970-8b17-355326a7a4c2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:55.342036 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-610813e1-9620-4970-8b17-355326a7a4c2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:55.433004 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-610813e1-9620-4970-8b17-355326a7a4c2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:55.442698 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-610813e1-9620-4970-8b17-355326a7a4c2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 200 len: 1613 microversion: 2.1 time: 0.114547 Jun 27 09:40:55.443493 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 323/621] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:55 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 1613 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:40:55.484776 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-2fcf16ae-37fa-444a-95fd-cbbf0655ec47 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:55.485397 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-2fcf16ae-37fa-444a-95fd-cbbf0655ec47 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:55.498340 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2fcf16ae-37fa-444a-95fd-cbbf0655ec47 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:55.499087 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2fcf16ae-37fa-444a-95fd-cbbf0655ec47 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:55.500289 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2fcf16ae-37fa-444a-95fd-cbbf0655ec47 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:55.500949 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2fcf16ae-37fa-444a-95fd-cbbf0655ec47 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:55.515800 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-b7310997-6c24-4a17-9de6-ee07681e27d8 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:55.528647 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-b7310997-6c24-4a17-9de6-ee07681e27d8 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1756 microversion: 2.1 time: 0.207801 Jun 27 09:40:55.529516 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 299/622] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:55 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1756 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:40:55.645772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2fcf16ae-37fa-444a-95fd-cbbf0655ec47 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:55.653723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2fcf16ae-37fa-444a-95fd-cbbf0655ec47 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:55.655223 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2fcf16ae-37fa-444a-95fd-cbbf0655ec47 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:55.656356 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-2fcf16ae-37fa-444a-95fd-cbbf0655ec47 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1408 microversion: 2.20 time: 0.175613 Jun 27 09:40:55.658631 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 324/623] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:40:55 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:40:56.461041 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-3673ba07-6f5e-4a23-85dd-3d038db66cd7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:56.461556 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-3673ba07-6f5e-4a23-85dd-3d038db66cd7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:56.472390 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3673ba07-6f5e-4a23-85dd-3d038db66cd7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:56.472844 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3673ba07-6f5e-4a23-85dd-3d038db66cd7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:56.473651 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3673ba07-6f5e-4a23-85dd-3d038db66cd7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:56.474112 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3673ba07-6f5e-4a23-85dd-3d038db66cd7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:56.487975 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-3673ba07-6f5e-4a23-85dd-3d038db66cd7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] HTTP exception thrown: Instance 102adf3a-476d-4af7-8267-15e963425bde could not be found. Jun 27 09:40:56.489496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-3673ba07-6f5e-4a23-85dd-3d038db66cd7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Request method failure captured: Jun 27 09:40:56.489496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde HTTP/1.1 Jun 27 09:40:56.489496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:40:56.489496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:40:56.489496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:40:56.489496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:40:56.489496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:40:56.489496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:40:56.489496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:40:56.489496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:40:56.489496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXpn-3iJO0jmG6cEr_seNLdcseHi8n8wEHckwmRo6ljOk7Dw2fW8MzVJsAVvtrRo6EbRwOL-ZWvD5H6s-lM4yKMyphFO-R0p3TN9KgYR5zUQQ4U5gMxDEUMuzuQRv_UTCVszqW1Rzxb7_cNEjM991nroZ5_Kz-paBsAlLj4MpU5gWgY Jun 27 09:40:56.489496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:40:56.489496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:40:56.489496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:40:56.489496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:40:56.489496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:40:56.489496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:40:56.489496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:40:56.489496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:40:56.489496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:40:56.489496 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:40:56.491099 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4b698ead017b4ef8b397ee127b487309", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:40:56.491099 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:40:56.491099 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:40:56.491099 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:40:56.491099 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:40:56.491099 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:40:56.491099 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:40:56.491099 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: cc8a087e97424d2890952be33695378f Jun 27 09:40:56.491099 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:40:56.491099 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: > Jun 27 09:40:56.491099 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Instance 102adf3a-476d-4af7-8267-15e963425bde could not be found. Jun 27 09:40:56.491099 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': '102adf3a-476d-4af7-8267-15e963425bde'} Jun 27 09:40:56.492014 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:40:56.492014 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:40:56.492014 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:40:56.492014 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:40:56.492014 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:40:56.492014 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:40:56.492014 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:40:56.492014 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:40:56.492014 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:40:56.492014 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:40:56.492014 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 102adf3a-476d-4af7-8267-15e963425bde could not be found. Jun 27 09:40:56.492014 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:40:56.492014 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:40:56.492014 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:40:56.492014 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:40:56.492014 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:40:56.492014 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:40:56.492014 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:40:56.492014 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:40:56.492014 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:40:56.493434 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:40:56.493434 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:40:56.493434 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:40:56.493434 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:40:56.493434 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:40:56.493434 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:40:56.493434 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:40:56.493434 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 102adf3a-476d-4af7-8267-15e963425bde could not be found. Jun 27 09:40:56.493434 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:40:56.493434 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:40:56.493434 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:40:56.493434 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:40:56.493434 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:40:56.493434 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:40:56.493434 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:40:56.493434 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:40:56.493434 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 102adf3a-476d-4af7-8267-15e963425bde could not be found. Jun 27 09:40:56.493434 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:40:56.494712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-3673ba07-6f5e-4a23-85dd-3d038db66cd7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Returning 404 to user: Instance 102adf3a-476d-4af7-8267-15e963425bde could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:40:56.494712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-3673ba07-6f5e-4a23-85dd-3d038db66cd7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 404 len: 111 microversion: 2.1 time: 0.034121 Jun 27 09:40:56.494712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 300/624] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:56 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:40:56.499911 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-70e35d7c-dd3d-4d40-a94e-c8f3af8fbd8e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '.version_select at 0x7ffa9741e670>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:56.546404 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-2b07a68d-edfc-499a-97b9-3d64869cb8ea tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:56.547020 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-2b07a68d-edfc-499a-97b9-3d64869cb8ea tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:56.553120 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2b07a68d-edfc-499a-97b9-3d64869cb8ea tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:56.553555 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2b07a68d-edfc-499a-97b9-3d64869cb8ea tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:56.555306 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2b07a68d-edfc-499a-97b9-3d64869cb8ea tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:56.555306 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2b07a68d-edfc-499a-97b9-3d64869cb8ea tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:56.575611 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-70e35d7c-dd3d-4d40-a94e-c8f3af8fbd8e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2143385650" status: 202 len: 0 microversion: 2.1 time: 0.079313 Jun 27 09:40:56.576718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 325/625] 10.222.0.64 () {58 vars in 1220 bytes} [Mon Jun 27 09:40:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2143385650 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:40:56.676094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-5ba197bb-6ce0-455d-b962-ca5db9d49afa tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:56.676789 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-5ba197bb-6ce0-455d-b962-ca5db9d49afa tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:56.683633 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5ba197bb-6ce0-455d-b962-ca5db9d49afa tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:56.684230 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5ba197bb-6ce0-455d-b962-ca5db9d49afa tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:56.685089 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5ba197bb-6ce0-455d-b962-ca5db9d49afa tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:56.685654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5ba197bb-6ce0-455d-b962-ca5db9d49afa tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:56.774334 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-2b07a68d-edfc-499a-97b9-3d64869cb8ea tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:56.782513 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-2b07a68d-edfc-499a-97b9-3d64869cb8ea tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1756 microversion: 2.1 time: 0.239881 Jun 27 09:40:56.783085 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 301/626] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:56 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1756 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:40:56.832661 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-5ba197bb-6ce0-455d-b962-ca5db9d49afa tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:56.841346 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-5ba197bb-6ce0-455d-b962-ca5db9d49afa tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:56.842844 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-5ba197bb-6ce0-455d-b962-ca5db9d49afa tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:56.844007 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-5ba197bb-6ce0-455d-b962-ca5db9d49afa tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1408 microversion: 2.20 time: 0.173759 Jun 27 09:40:56.844572 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 326/627] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:40:56 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:40:57.462636 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-7da2f4ad-2b40-4c70-bbf3-57a076d0264b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:57.463184 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-7da2f4ad-2b40-4c70-bbf3-57a076d0264b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:57.465092 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=6 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:57.470113 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7da2f4ad-2b40-4c70-bbf3-57a076d0264b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:57.470565 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7da2f4ad-2b40-4c70-bbf3-57a076d0264b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:57.472912 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7da2f4ad-2b40-4c70-bbf3-57a076d0264b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:57.472912 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7da2f4ad-2b40-4c70-bbf3-57a076d0264b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:57.551410 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.objects.instance [None req-7da2f4ad-2b40-4c70-bbf3-57a076d0264b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lazy-loading 'services' on Instance uuid 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 {{(pid=124870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:40:57.744491 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-7da2f4ad-2b40-4c70-bbf3-57a076d0264b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2/os-volume_attachments/73d849d8-5ad9-49fb-bef8-123399e09e06" status: 202 len: 0 microversion: 2.1 time: 0.286084 Jun 27 09:40:57.745073 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 302/628] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jun 27 09:40:57 2022] DELETE /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2/os-volume_attachments/73d849d8-5ad9-49fb-bef8-123399e09e06 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:40:57.753262 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-55d6964b-15fc-424b-9de3-eacbc05f5a37 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:57.754196 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-55d6964b-15fc-424b-9de3-eacbc05f5a37 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:57.756170 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell0:SELECT=2 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:57.756829 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell0:SELECT=6 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:57.762084 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-55d6964b-15fc-424b-9de3-eacbc05f5a37 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:57.762555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-55d6964b-15fc-424b-9de3-eacbc05f5a37 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:57.763308 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-55d6964b-15fc-424b-9de3-eacbc05f5a37 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:57.763782 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-55d6964b-15fc-424b-9de3-eacbc05f5a37 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:57.793881 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-55d6964b-15fc-424b-9de3-eacbc05f5a37 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044401 Jun 27 09:40:57.794422 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 327/629] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 27 09:40:57 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:40:57.800177 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-b6ef0dba-aaad-49f9-81cd-95a6a3c9c518 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:57.800906 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-b6ef0dba-aaad-49f9-81cd-95a6a3c9c518 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:57.807168 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b6ef0dba-aaad-49f9-81cd-95a6a3c9c518 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:57.807663 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b6ef0dba-aaad-49f9-81cd-95a6a3c9c518 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:57.808462 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b6ef0dba-aaad-49f9-81cd-95a6a3c9c518 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:57.808902 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b6ef0dba-aaad-49f9-81cd-95a6a3c9c518 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:57.862082 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-bcc4ea88-0ef9-49b4-ac90-581598561253 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:57.862689 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-bcc4ea88-0ef9-49b4-ac90-581598561253 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:57.869224 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-bcc4ea88-0ef9-49b4-ac90-581598561253 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:57.869676 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-bcc4ea88-0ef9-49b4-ac90-581598561253 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:57.870466 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-bcc4ea88-0ef9-49b4-ac90-581598561253 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:57.870906 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-bcc4ea88-0ef9-49b4-ac90-581598561253 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:57.951556 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-b6ef0dba-aaad-49f9-81cd-95a6a3c9c518 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:57.959659 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-b6ef0dba-aaad-49f9-81cd-95a6a3c9c518 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1756 microversion: 2.1 time: 0.163641 Jun 27 09:40:57.960273 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 303/630] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:57 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:58.001242 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-bcc4ea88-0ef9-49b4-ac90-581598561253 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:58.009840 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-bcc4ea88-0ef9-49b4-ac90-581598561253 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:58.011328 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-bcc4ea88-0ef9-49b4-ac90-581598561253 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:58.012472 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-bcc4ea88-0ef9-49b4-ac90-581598561253 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1408 microversion: 2.20 time: 0.154255 Jun 27 09:40:58.013015 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 328/631] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:40:57 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:40:58.802372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-9cc10fee-69e8-493b-ad8a-21566fbd9ce6 req-2d1468ac-c8d6-443e-89a4-ffd12b14cdc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "448074d1-f23d-4254-a9ec-26b00bd1298c", "name": "network-vif-plugged", "status": "completed", "tag": "55e62be6-d365-40b9-9f9d-24357beba5b2"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:40:58.806895 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-1334c606-6840-4c76-aa2b-68357ce1fc2d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:58.807886 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-1334c606-6840-4c76-aa2b-68357ce1fc2d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:58.812175 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-9cc10fee-69e8-493b-ad8a-21566fbd9ce6 req-2d1468ac-c8d6-443e-89a4-ffd12b14cdc1 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:58.812615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-9cc10fee-69e8-493b-ad8a-21566fbd9ce6 req-2d1468ac-c8d6-443e-89a4-ffd12b14cdc1 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:58.814169 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1334c606-6840-4c76-aa2b-68357ce1fc2d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:58.814617 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1334c606-6840-4c76-aa2b-68357ce1fc2d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:58.815384 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1334c606-6840-4c76-aa2b-68357ce1fc2d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:58.815955 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1334c606-6840-4c76-aa2b-68357ce1fc2d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:58.823802 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-9cc10fee-69e8-493b-ad8a-21566fbd9ce6 req-2d1468ac-c8d6-443e-89a4-ffd12b14cdc1 service nova] Creating event network-vif-plugged:55e62be6-d365-40b9-9f9d-24357beba5b2 for instance 448074d1-f23d-4254-a9ec-26b00bd1298c on hv-cinder-84773 Jun 27 09:40:58.828656 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-9cc10fee-69e8-493b-ad8a-21566fbd9ce6 req-2d1468ac-c8d6-443e-89a4-ffd12b14cdc1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030026 Jun 27 09:40:58.829218 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 304/632] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:40:58.843344 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:40:58.848332 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-1334c606-6840-4c76-aa2b-68357ce1fc2d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046783 Jun 27 09:40:58.849034 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 329/633] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 27 09:40:58 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:40:58.978611 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-4a4b5752-afd4-4918-848f-2132de7ec14b tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:58.979234 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-4a4b5752-afd4-4918-848f-2132de7ec14b tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:58.985541 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4a4b5752-afd4-4918-848f-2132de7ec14b tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:58.986052 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4a4b5752-afd4-4918-848f-2132de7ec14b tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:58.986809 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4a4b5752-afd4-4918-848f-2132de7ec14b tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:58.987239 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4a4b5752-afd4-4918-848f-2132de7ec14b tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:59.031036 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-4ddea1bc-48cf-4bb6-8080-f9adae8ab481 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:59.031830 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-4ddea1bc-48cf-4bb6-8080-f9adae8ab481 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:59.038811 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4ddea1bc-48cf-4bb6-8080-f9adae8ab481 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:59.040083 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4ddea1bc-48cf-4bb6-8080-f9adae8ab481 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:59.041071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4ddea1bc-48cf-4bb6-8080-f9adae8ab481 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:59.041559 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4ddea1bc-48cf-4bb6-8080-f9adae8ab481 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:59.140784 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4a4b5752-afd4-4918-848f-2132de7ec14b tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:59.161082 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-4a4b5752-afd4-4918-848f-2132de7ec14b tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1756 microversion: 2.1 time: 0.187297 Jun 27 09:40:59.161886 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 305/634] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:40:58 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:40:59.185681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4ddea1bc-48cf-4bb6-8080-f9adae8ab481 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:59.194201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4ddea1bc-48cf-4bb6-8080-f9adae8ab481 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:59.195783 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4ddea1bc-48cf-4bb6-8080-f9adae8ab481 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:40:59.196887 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-4ddea1bc-48cf-4bb6-8080-f9adae8ab481 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1408 microversion: 2.20 time: 0.170163 Jun 27 09:40:59.197436 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 330/635] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:40:59 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:40:59.859681 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-3cd03221-d877-40e2-97e0-8166f62ef747 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:59.860533 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-3cd03221-d877-40e2-97e0-8166f62ef747 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:59.866631 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3cd03221-d877-40e2-97e0-8166f62ef747 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:59.867074 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3cd03221-d877-40e2-97e0-8166f62ef747 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:59.868355 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3cd03221-d877-40e2-97e0-8166f62ef747 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:59.868782 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3cd03221-d877-40e2-97e0-8166f62ef747 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:59.897041 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-3cd03221-d877-40e2-97e0-8166f62ef747 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041404 Jun 27 09:40:59.897577 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 306/636] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 27 09:40:59 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 09:40:59.953950 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-a06bdf27-a1bc-4edf-b0ed-a4ef56e9702e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:40:59.954455 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-a06bdf27-a1bc-4edf-b0ed-a4ef56e9702e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:40:59.960906 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a06bdf27-a1bc-4edf-b0ed-a4ef56e9702e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:59.961848 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a06bdf27-a1bc-4edf-b0ed-a4ef56e9702e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:59.962619 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a06bdf27-a1bc-4edf-b0ed-a4ef56e9702e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:40:59.963051 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a06bdf27-a1bc-4edf-b0ed-a4ef56e9702e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:40:59.988391 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-a06bdf27-a1bc-4edf-b0ed-a4ef56e9702e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Going to try to terminate instance {{(pid=124869) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 09:41:00.178918 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e8e49680-460c-42f2-b505-49e56993837d tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:00.179545 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e8e49680-460c-42f2-b505-49e56993837d tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:00.186184 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e8e49680-460c-42f2-b505-49e56993837d tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:00.186627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e8e49680-460c-42f2-b505-49e56993837d tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:00.187376 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e8e49680-460c-42f2-b505-49e56993837d tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:00.187844 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e8e49680-460c-42f2-b505-49e56993837d tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:00.225968 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:00.288565 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-a06bdf27-a1bc-4edf-b0ed-a4ef56e9702e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 204 len: 0 microversion: 2.1 time: 0.338084 Jun 27 09:41:00.290060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 331/637] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:40:59 2022] DELETE /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 09:41:00.298658 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-66d08e90-7605-4f39-a690-a9236997cd45 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:00.299476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-66d08e90-7605-4f39-a690-a9236997cd45 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:00.306001 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-66d08e90-7605-4f39-a690-a9236997cd45 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:00.308990 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-66d08e90-7605-4f39-a690-a9236997cd45 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:00.308990 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-66d08e90-7605-4f39-a690-a9236997cd45 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:00.308990 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-66d08e90-7605-4f39-a690-a9236997cd45 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:00.329033 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-e8e49680-460c-42f2-b505-49e56993837d tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:00.337282 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e8e49680-460c-42f2-b505-49e56993837d tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1756 microversion: 2.1 time: 0.162324 Jun 27 09:41:00.338054 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 307/638] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:00 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:41:00.342278 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-1102db5d-4067-4032-8730-dd03f5a55aab tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:00.342932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-1102db5d-4067-4032-8730-dd03f5a55aab tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:00.348972 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1102db5d-4067-4032-8730-dd03f5a55aab tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:00.349489 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1102db5d-4067-4032-8730-dd03f5a55aab tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:00.350263 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1102db5d-4067-4032-8730-dd03f5a55aab tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:00.350694 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1102db5d-4067-4032-8730-dd03f5a55aab tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:00.372813 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:00.444453 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-66d08e90-7605-4f39-a690-a9236997cd45 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:00.454315 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-66d08e90-7605-4f39-a690-a9236997cd45 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:00.455856 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-66d08e90-7605-4f39-a690-a9236997cd45 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:00.457088 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-66d08e90-7605-4f39-a690-a9236997cd45 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1408 microversion: 2.20 time: 0.162507 Jun 27 09:41:00.457642 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 332/639] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:41:00 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:41:00.487940 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-1102db5d-4067-4032-8730-dd03f5a55aab tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:00.495392 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-1102db5d-4067-4032-8730-dd03f5a55aab tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1681 microversion: 2.1 time: 0.156548 Jun 27 09:41:00.495981 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 308/640] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:00 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:01.355089 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-34413d7f-1e63-4570-a88e-829d4cf09eb9 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:01.355729 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-34413d7f-1e63-4570-a88e-829d4cf09eb9 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:01.362382 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-34413d7f-1e63-4570-a88e-829d4cf09eb9 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:01.362837 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-34413d7f-1e63-4570-a88e-829d4cf09eb9 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:01.363630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-34413d7f-1e63-4570-a88e-829d4cf09eb9 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:01.364074 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-34413d7f-1e63-4570-a88e-829d4cf09eb9 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:01.476052 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-db3de8a6-22c0-46d2-b17d-09e0be28baf2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:01.477251 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-db3de8a6-22c0-46d2-b17d-09e0be28baf2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:01.479547 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:01.485502 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-db3de8a6-22c0-46d2-b17d-09e0be28baf2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:01.485953 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-db3de8a6-22c0-46d2-b17d-09e0be28baf2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:01.486728 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-db3de8a6-22c0-46d2-b17d-09e0be28baf2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:01.487213 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-db3de8a6-22c0-46d2-b17d-09e0be28baf2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:01.509034 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-34413d7f-1e63-4570-a88e-829d4cf09eb9 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:01.517204 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-34413d7f-1e63-4570-a88e-829d4cf09eb9 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1756 microversion: 2.1 time: 0.166949 Jun 27 09:41:01.517785 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 333/641] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:01 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:01.522272 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-6509bbbe-1d77-4892-bc5f-765fadd9975e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:01.522878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-6509bbbe-1d77-4892-bc5f-765fadd9975e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:01.529421 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6509bbbe-1d77-4892-bc5f-765fadd9975e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:01.529805 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6509bbbe-1d77-4892-bc5f-765fadd9975e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:01.530577 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6509bbbe-1d77-4892-bc5f-765fadd9975e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:01.531021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6509bbbe-1d77-4892-bc5f-765fadd9975e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:01.623716 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-db3de8a6-22c0-46d2-b17d-09e0be28baf2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:01.633570 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-db3de8a6-22c0-46d2-b17d-09e0be28baf2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:01.635170 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-db3de8a6-22c0-46d2-b17d-09e0be28baf2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:01.636480 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-db3de8a6-22c0-46d2-b17d-09e0be28baf2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1599 microversion: 2.20 time: 0.164770 Jun 27 09:41:01.642661 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 309/642] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:41:01 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:41:01.654642 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-953f44b9-0bc0-47cb-b1f3-54fb55bd754e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:01.655129 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-953f44b9-0bc0-47cb-b1f3-54fb55bd754e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:01.661326 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-953f44b9-0bc0-47cb-b1f3-54fb55bd754e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:01.661636 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-953f44b9-0bc0-47cb-b1f3-54fb55bd754e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:01.662394 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-953f44b9-0bc0-47cb-b1f3-54fb55bd754e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:01.662827 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-953f44b9-0bc0-47cb-b1f3-54fb55bd754e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:01.663939 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6509bbbe-1d77-4892-bc5f-765fadd9975e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:01.671807 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-6509bbbe-1d77-4892-bc5f-765fadd9975e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1681 microversion: 2.1 time: 0.153033 Jun 27 09:41:01.677054 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 334/643] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:01 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:01.742351 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-953f44b9-0bc0-47cb-b1f3-54fb55bd754e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091434 Jun 27 09:41:01.742940 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 310/644] 10.222.0.64 () {60 vars in 1315 bytes} [Mon Jun 27 09:41:01 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 09:41:02.534371 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-a552563f-2300-454c-82e7-bf1383a7c6d7 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:02.535329 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-a552563f-2300-454c-82e7-bf1383a7c6d7 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:02.545345 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a552563f-2300-454c-82e7-bf1383a7c6d7 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:02.545791 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a552563f-2300-454c-82e7-bf1383a7c6d7 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:02.546559 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a552563f-2300-454c-82e7-bf1383a7c6d7 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:02.547127 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a552563f-2300-454c-82e7-bf1383a7c6d7 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:02.695605 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-5faf8bb1-7f4a-42cd-88b4-d695129c2949 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:02.695605 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-5faf8bb1-7f4a-42cd-88b4-d695129c2949 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:02.708754 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5faf8bb1-7f4a-42cd-88b4-d695129c2949 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:02.709606 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5faf8bb1-7f4a-42cd-88b4-d695129c2949 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:02.710850 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5faf8bb1-7f4a-42cd-88b4-d695129c2949 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:02.712178 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5faf8bb1-7f4a-42cd-88b4-d695129c2949 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:02.854795 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-5faf8bb1-7f4a-42cd-88b4-d695129c2949 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:02.862267 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-5faf8bb1-7f4a-42cd-88b4-d695129c2949 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1681 microversion: 2.1 time: 0.173090 Jun 27 09:41:02.863114 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 311/645] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:02 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:02.867560 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-1062be07-830c-43fa-b3dd-7b013c57af08 req-ae1dfa2c-0179-4945-9e5d-d2ca4180ca87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "448074d1-f23d-4254-a9ec-26b00bd1298c", "tag": "55e62be6-d365-40b9-9f9d-24357beba5b2"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:41:02.869916 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-a552563f-2300-454c-82e7-bf1383a7c6d7 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:02.877410 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-1062be07-830c-43fa-b3dd-7b013c57af08 req-ae1dfa2c-0179-4945-9e5d-d2ca4180ca87 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:02.877894 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-1062be07-830c-43fa-b3dd-7b013c57af08 req-ae1dfa2c-0179-4945-9e5d-d2ca4180ca87 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:02.878391 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-a552563f-2300-454c-82e7-bf1383a7c6d7 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1756 microversion: 2.1 time: 0.347983 Jun 27 09:41:02.879579 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 335/646] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:02 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1756 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:02.890301 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-1062be07-830c-43fa-b3dd-7b013c57af08 req-ae1dfa2c-0179-4945-9e5d-d2ca4180ca87 service nova] Creating event network-changed:55e62be6-d365-40b9-9f9d-24357beba5b2 for instance 448074d1-f23d-4254-a9ec-26b00bd1298c on hv-cinder-84773 Jun 27 09:41:02.895285 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-1062be07-830c-43fa-b3dd-7b013c57af08 req-ae1dfa2c-0179-4945-9e5d-d2ca4180ca87 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031164 Jun 27 09:41:02.896007 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 312/647] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:41:03.879440 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-48d5bd0c-2261-45f3-bfaa-d9a59cb75976 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:03.880120 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-48d5bd0c-2261-45f3-bfaa-d9a59cb75976 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:03.888988 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-48d5bd0c-2261-45f3-bfaa-d9a59cb75976 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:03.889437 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-48d5bd0c-2261-45f3-bfaa-d9a59cb75976 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:03.890524 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-48d5bd0c-2261-45f3-bfaa-d9a59cb75976 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:03.890968 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-48d5bd0c-2261-45f3-bfaa-d9a59cb75976 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:03.896906 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-5d68c04a-f424-4271-8672-c5f4ec07770e tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:03.899974 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-5d68c04a-f424-4271-8672-c5f4ec07770e tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:03.909236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5d68c04a-f424-4271-8672-c5f4ec07770e tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:03.909921 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5d68c04a-f424-4271-8672-c5f4ec07770e tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:03.913784 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5d68c04a-f424-4271-8672-c5f4ec07770e tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:03.913784 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5d68c04a-f424-4271-8672-c5f4ec07770e tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:03.968976 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-48d5bd0c-2261-45f3-bfaa-d9a59cb75976 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:03.980038 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-48d5bd0c-2261-45f3-bfaa-d9a59cb75976 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 200 len: 1614 microversion: 2.1 time: 0.104257 Jun 27 09:41:03.989904 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 336/648] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:03 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 1614 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:04.077820 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-5d68c04a-f424-4271-8672-c5f4ec07770e tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:04.086691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-5d68c04a-f424-4271-8672-c5f4ec07770e tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1756 microversion: 2.1 time: 0.194721 Jun 27 09:41:04.096978 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 313/649] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:03 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1756 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:41:04.909878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-834992b8-d6ba-4077-9461-0f21a917c561 req-0231f00a-f7c4-4494-8219-38e2cfe2fcbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd479f3-f038-498f-b06d-c47cc1e8bfa2", "name": "network-vif-deleted", "tag": "95a7b7da-b0e9-4bbd-9924-d201c61db4b4"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:41:04.918778 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-834992b8-d6ba-4077-9461-0f21a917c561 req-0231f00a-f7c4-4494-8219-38e2cfe2fcbb service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:04.919446 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-834992b8-d6ba-4077-9461-0f21a917c561 req-0231f00a-f7c4-4494-8219-38e2cfe2fcbb service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:04.930270 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-834992b8-d6ba-4077-9461-0f21a917c561 req-0231f00a-f7c4-4494-8219-38e2cfe2fcbb service nova] Creating event network-vif-deleted:95a7b7da-b0e9-4bbd-9924-d201c61db4b4 for instance 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 on hv-cinder-84773 Jun 27 09:41:04.935245 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-834992b8-d6ba-4077-9461-0f21a917c561 req-0231f00a-f7c4-4494-8219-38e2cfe2fcbb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029279 Jun 27 09:41:04.936120 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 337/650] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:41:04.998135 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-6c16b6a2-d9f0-451b-9361-4dedfd6b4af6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:04.998782 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-6c16b6a2-d9f0-451b-9361-4dedfd6b4af6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:05.005558 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6c16b6a2-d9f0-451b-9361-4dedfd6b4af6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:05.006017 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6c16b6a2-d9f0-451b-9361-4dedfd6b4af6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:05.006777 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6c16b6a2-d9f0-451b-9361-4dedfd6b4af6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:05.007220 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6c16b6a2-d9f0-451b-9361-4dedfd6b4af6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:05.022524 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-6c16b6a2-d9f0-451b-9361-4dedfd6b4af6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] HTTP exception thrown: Instance 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 could not be found. Jun 27 09:41:05.024093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-6c16b6a2-d9f0-451b-9361-4dedfd6b4af6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Request method failure captured: Jun 27 09:41:05.024093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 HTTP/1.1 Jun 27 09:41:05.024093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:41:05.024093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:41:05.024093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:41:05.024093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:41:05.024093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:41:05.024093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:41:05.024093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:41:05.024093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:41:05.024093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXpn-3iJO0jmG6cEr_seNLdcseHi8n8wEHckwmRo6ljOk7Dw2fW8MzVJsAVvtrRo6EbRwOL-ZWvD5H6s-lM4yKMyphFO-R0p3TN9KgYR5zUQQ4U5gMxDEUMuzuQRv_UTCVszqW1Rzxb7_cNEjM991nroZ5_Kz-paBsAlLj4MpU5gWgY Jun 27 09:41:05.024093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:41:05.024093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:41:05.024093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:41:05.024093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:41:05.024093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:41:05.024093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:41:05.024093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:41:05.024093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:41:05.024093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:41:05.024093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:41:05.025468 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4b698ead017b4ef8b397ee127b487309", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:41:05.025468 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:41:05.025468 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:41:05.025468 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:41:05.025468 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:41:05.025468 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:41:05.025468 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:41:05.025468 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: cc8a087e97424d2890952be33695378f Jun 27 09:41:05.025468 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:41:05.025468 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: > Jun 27 09:41:05.025468 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Instance 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 could not be found. Jun 27 09:41:05.025468 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': '0dd479f3-f038-498f-b06d-c47cc1e8bfa2'} Jun 27 09:41:05.026236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:41:05.026236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:41:05.026236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:41:05.026236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:41:05.026236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:41:05.026236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:41:05.026236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:41:05.026236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:41:05.026236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:41:05.026236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:41:05.026236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 could not be found. Jun 27 09:41:05.026236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:41:05.026236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:41:05.026236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:41:05.026236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:41:05.026236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:41:05.026236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:41:05.026236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:41:05.026236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:41:05.026236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:41:05.027905 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:41:05.027905 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:41:05.027905 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:41:05.027905 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:41:05.027905 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:41:05.027905 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:41:05.027905 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:41:05.027905 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 could not be found. Jun 27 09:41:05.027905 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:41:05.027905 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:41:05.027905 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:41:05.027905 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:41:05.027905 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:41:05.027905 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:41:05.027905 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:41:05.027905 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:41:05.027905 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 could not be found. Jun 27 09:41:05.027905 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:41:05.029315 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-6c16b6a2-d9f0-451b-9361-4dedfd6b4af6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Returning 404 to user: Instance 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:41:05.029315 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-6c16b6a2-d9f0-451b-9361-4dedfd6b4af6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 404 len: 111 microversion: 2.1 time: 0.031290 Jun 27 09:41:05.029315 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 314/651] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:04 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:41:05.035115 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-330361ef-ff13-4f5f-9d44-3f7dda320d88 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '.version_select at 0x7ffa97424e50>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:05.103953 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-1cfd170a-0aa0-4636-8575-ed4f3f644d99 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:05.104565 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-1cfd170a-0aa0-4636-8575-ed4f3f644d99 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:05.110762 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1cfd170a-0aa0-4636-8575-ed4f3f644d99 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:05.111213 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1cfd170a-0aa0-4636-8575-ed4f3f644d99 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:05.112018 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1cfd170a-0aa0-4636-8575-ed4f3f644d99 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:05.112455 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1cfd170a-0aa0-4636-8575-ed4f3f644d99 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:05.124293 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-330361ef-ff13-4f5f-9d44-3f7dda320d88 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-920107729" status: 202 len: 0 microversion: 2.1 time: 0.093194 Jun 27 09:41:05.125851 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 338/652] 10.222.0.64 () {58 vars in 1217 bytes} [Mon Jun 27 09:41:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-920107729 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 09:41:05.348087 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-1cfd170a-0aa0-4636-8575-ed4f3f644d99 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:05.356695 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-1cfd170a-0aa0-4636-8575-ed4f3f644d99 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1756 microversion: 2.1 time: 0.256729 Jun 27 09:41:05.357266 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 315/653] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:05 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1756 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:41:05.905988 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-fba78bef-faa6-40e2-bf67-fa16c589883e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Action: 'create', calling method: .version_select at 0x7ffa9741e280>, body: {"keypair": {"name": "tempest-keypair-189199838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKj8reU4R8ADf6bcAnSwvOlbSgCQ+t2TiWyWy3tJQWuZf53vnS8huVyacVcT4nAqSTgV3SLlMBv07qvvNo3UI1Og4ZzIzG3aG8lbR9Gj9kVTsO/dsf+ftnlXXMvDIKP2g=="}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:41:05.922128 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-fba78bef-faa6-40e2-bf67-fa16c589883e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Getting quotas for project 4b698ead017b4ef8b397ee127b487309. Resources: {'key_pairs'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:41:05.925984 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-fba78bef-faa6-40e2-bf67-fa16c589883e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Getting quotas for user cc8a087e97424d2890952be33695378f and project 4b698ead017b4ef8b397ee127b487309. Resources: {'key_pairs'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:41:05.997938 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-fba78bef-faa6-40e2-bf67-fa16c589883e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.095830 Jun 27 09:41:05.998540 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 339/654] 10.222.0.64 () {60 vars in 1158 bytes} [Mon Jun 27 09:41:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:41:06.373779 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-4fadf918-ab91-4934-9a89-07836883cfbb tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:06.374395 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-4fadf918-ab91-4934-9a89-07836883cfbb tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:06.380877 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4fadf918-ab91-4934-9a89-07836883cfbb tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:06.381323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4fadf918-ab91-4934-9a89-07836883cfbb tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:06.382085 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4fadf918-ab91-4934-9a89-07836883cfbb tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:06.382520 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4fadf918-ab91-4934-9a89-07836883cfbb tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:06.524361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4fadf918-ab91-4934-9a89-07836883cfbb tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:06.533490 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-4fadf918-ab91-4934-9a89-07836883cfbb tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1756 microversion: 2.1 time: 0.163423 Jun 27 09:41:06.534428 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 316/655] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:06 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:07.552284 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-92e98101-7986-4ca7-83ea-54c222237f5d tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:07.553013 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-92e98101-7986-4ca7-83ea-54c222237f5d tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:07.559230 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-92e98101-7986-4ca7-83ea-54c222237f5d tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:07.559715 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-92e98101-7986-4ca7-83ea-54c222237f5d tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:07.560536 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-92e98101-7986-4ca7-83ea-54c222237f5d tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:07.561049 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-92e98101-7986-4ca7-83ea-54c222237f5d tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:07.763742 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-92e98101-7986-4ca7-83ea-54c222237f5d tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:07.771721 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-92e98101-7986-4ca7-83ea-54c222237f5d tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1756 microversion: 2.1 time: 0.223930 Jun 27 09:41:07.772288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 340/656] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:07 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1756 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:08.161788 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-f74d5dfa-5efd-43e4-a879-8caad86ec42f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-837787628", "imageRef": "96dfa32c-d52f-4225-8918-743ebc97f4bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "44332445-ecaa-4205-9b0a-eb56bcdc88ee"}], "security_groups": [{"name": "tempest-securitygroup--923251333"}], "key_name": "tempest-keypair-189199838", "user_data": "}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:41:08.262699 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.network.neutron [None req-f74d5dfa-5efd-43e4-a879-8caad86ec42f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] validate_networks() for [('44332445-ecaa-4205-9b0a-eb56bcdc88ee', None, None, None, None, None)] {{(pid=124870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 09:41:08.789004 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-0ed35d87-5be5-4797-bd55-1a0fa2d16920 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:08.790280 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-0ed35d87-5be5-4797-bd55-1a0fa2d16920 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:08.797269 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0ed35d87-5be5-4797-bd55-1a0fa2d16920 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:08.797710 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0ed35d87-5be5-4797-bd55-1a0fa2d16920 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:08.798481 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0ed35d87-5be5-4797-bd55-1a0fa2d16920 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:08.798915 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0ed35d87-5be5-4797-bd55-1a0fa2d16920 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:08.877317 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-f74d5dfa-5efd-43e4-a879-8caad86ec42f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Flavor limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 09:41:08.877792 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-f74d5dfa-5efd-43e4-a879-8caad86ec42f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Image limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 09:41:08.878266 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-f74d5dfa-5efd-43e4-a879-8caad86ec42f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Flavor pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 09:41:08.878676 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-f74d5dfa-5efd-43e4-a879-8caad86ec42f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Image pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 09:41:08.879389 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-f74d5dfa-5efd-43e4-a879-8caad86ec42f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 09:41:08.888390 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f74d5dfa-5efd-43e4-a879-8caad86ec42f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:08.888888 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f74d5dfa-5efd-43e4-a879-8caad86ec42f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:08.899736 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f74d5dfa-5efd-43e4-a879-8caad86ec42f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:08.899736 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f74d5dfa-5efd-43e4-a879-8caad86ec42f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:08.907744 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-f74d5dfa-5efd-43e4-a879-8caad86ec42f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Getting quotas for project 4b698ead017b4ef8b397ee127b487309. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:41:08.911760 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-f74d5dfa-5efd-43e4-a879-8caad86ec42f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Getting quotas for user cc8a087e97424d2890952be33695378f and project 4b698ead017b4ef8b397ee127b487309. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:41:08.923940 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-f74d5dfa-5efd-43e4-a879-8caad86ec42f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Going to run 1 instances... {{(pid=124870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 09:41:08.926198 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-f74d5dfa-5efd-43e4-a879-8caad86ec42f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96dfa32c-d52f-4225-8918-743ebc97f4bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 09:41:08.945802 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-0ed35d87-5be5-4797-bd55-1a0fa2d16920 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:08.956087 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-0ed35d87-5be5-4797-bd55-1a0fa2d16920 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1759 microversion: 2.1 time: 0.170904 Jun 27 09:41:08.956657 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 341/657] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:08 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:41:09.039149 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-f74d5dfa-5efd-43e4-a879-8caad86ec42f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.881536 Jun 27 09:41:09.040514 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 317/658] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 27 09:41:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 09:41:09.050890 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-4e9e1572-cdf5-4f71-aa7e-3943e3899759 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:09.051556 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-4e9e1572-cdf5-4f71-aa7e-3943e3899759 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:09.104756 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4e9e1572-cdf5-4f71-aa7e-3943e3899759 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:09.111456 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-4e9e1572-cdf5-4f71-aa7e-3943e3899759 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380" status: 200 len: 1240 microversion: 2.1 time: 0.064375 Jun 27 09:41:09.112439 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 342/659] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:09 2022] GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380 => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:10.128722 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-2dc80995-7691-4a95-a40e-753b79fe95d0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:10.129334 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-2dc80995-7691-4a95-a40e-753b79fe95d0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:10.135426 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2dc80995-7691-4a95-a40e-753b79fe95d0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:10.135910 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2dc80995-7691-4a95-a40e-753b79fe95d0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:10.136656 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2dc80995-7691-4a95-a40e-753b79fe95d0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:10.137085 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2dc80995-7691-4a95-a40e-753b79fe95d0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:10.196976 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-2dc80995-7691-4a95-a40e-753b79fe95d0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:10.204384 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-2dc80995-7691-4a95-a40e-753b79fe95d0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380" status: 200 len: 1236 microversion: 2.1 time: 0.080075 Jun 27 09:41:10.204946 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 318/660] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:10 2022] GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380 => generated 1236 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:41:11.222410 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-936a73b7-3d8d-4140-a9d5-eb8ddf3cde4d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:11.223032 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-936a73b7-3d8d-4140-a9d5-eb8ddf3cde4d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:11.230444 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-936a73b7-3d8d-4140-a9d5-eb8ddf3cde4d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:11.230898 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-936a73b7-3d8d-4140-a9d5-eb8ddf3cde4d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:11.231713 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-936a73b7-3d8d-4140-a9d5-eb8ddf3cde4d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:11.232157 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-936a73b7-3d8d-4140-a9d5-eb8ddf3cde4d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:11.298349 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-936a73b7-3d8d-4140-a9d5-eb8ddf3cde4d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:11.306194 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-936a73b7-3d8d-4140-a9d5-eb8ddf3cde4d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380" status: 200 len: 1298 microversion: 2.1 time: 0.088064 Jun 27 09:41:11.306761 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 343/661] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:11 2022] GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380 => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:12.328507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-28e2a8da-4ad5-46a4-ac69-a278346b30e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:12.328507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-28e2a8da-4ad5-46a4-ac69-a278346b30e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:12.332046 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-28e2a8da-4ad5-46a4-ac69-a278346b30e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:12.332497 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-28e2a8da-4ad5-46a4-ac69-a278346b30e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:12.333281 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-28e2a8da-4ad5-46a4-ac69-a278346b30e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:12.333880 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-28e2a8da-4ad5-46a4-ac69-a278346b30e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:12.523358 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-28e2a8da-4ad5-46a4-ac69-a278346b30e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:12.530954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-28e2a8da-4ad5-46a4-ac69-a278346b30e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380" status: 200 len: 1365 microversion: 2.1 time: 0.212559 Jun 27 09:41:12.531519 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 319/662] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:12 2022] GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:12.639316 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-fdbc70b3-e6cd-422f-bfc6-6218aed9d1ca req-6213fe88-29d0-4897-823d-9e29cddf7ddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70f57aa8-bd53-4836-97d8-44a90cfb3380", "tag": "a2d19843-8e0c-4622-9baa-515a05143fb7"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:41:12.649968 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-fdbc70b3-e6cd-422f-bfc6-6218aed9d1ca req-6213fe88-29d0-4897-823d-9e29cddf7ddf service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:12.650722 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-fdbc70b3-e6cd-422f-bfc6-6218aed9d1ca req-6213fe88-29d0-4897-823d-9e29cddf7ddf service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:12.667463 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-fdbc70b3-e6cd-422f-bfc6-6218aed9d1ca req-6213fe88-29d0-4897-823d-9e29cddf7ddf service nova] Creating event network-changed:a2d19843-8e0c-4622-9baa-515a05143fb7 for instance 70f57aa8-bd53-4836-97d8-44a90cfb3380 on hv-cinder-84773 Jun 27 09:41:12.672870 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-fdbc70b3-e6cd-422f-bfc6-6218aed9d1ca req-6213fe88-29d0-4897-823d-9e29cddf7ddf service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039312 Jun 27 09:41:12.673479 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 344/663] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:41:13.548203 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-4064413e-9388-461e-85e6-ba8e4f8c0556 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:13.548812 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-4064413e-9388-461e-85e6-ba8e4f8c0556 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:13.555219 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4064413e-9388-461e-85e6-ba8e4f8c0556 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:13.555707 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4064413e-9388-461e-85e6-ba8e4f8c0556 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:13.556469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4064413e-9388-461e-85e6-ba8e4f8c0556 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:13.556902 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4064413e-9388-461e-85e6-ba8e4f8c0556 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:13.687082 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4064413e-9388-461e-85e6-ba8e4f8c0556 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:13.694715 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-4064413e-9388-461e-85e6-ba8e4f8c0556 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380" status: 200 len: 1365 microversion: 2.1 time: 0.150461 Jun 27 09:41:13.695278 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 320/664] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:13 2022] GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:14.712268 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-7fb3b11f-d373-4d32-a41f-ae0345677a42 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:14.713611 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-7fb3b11f-d373-4d32-a41f-ae0345677a42 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:14.719896 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7fb3b11f-d373-4d32-a41f-ae0345677a42 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:14.720351 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7fb3b11f-d373-4d32-a41f-ae0345677a42 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:14.721376 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7fb3b11f-d373-4d32-a41f-ae0345677a42 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:14.721583 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7fb3b11f-d373-4d32-a41f-ae0345677a42 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:14.852176 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-7fb3b11f-d373-4d32-a41f-ae0345677a42 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:14.860125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-7fb3b11f-d373-4d32-a41f-ae0345677a42 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380" status: 200 len: 1365 microversion: 2.1 time: 0.152545 Jun 27 09:41:14.863671 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 345/665] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:14 2022] GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:15.876668 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-2a1676fe-07f1-440e-88ea-6417f174b16d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:15.877198 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-2a1676fe-07f1-440e-88ea-6417f174b16d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:15.883665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2a1676fe-07f1-440e-88ea-6417f174b16d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:15.884116 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2a1676fe-07f1-440e-88ea-6417f174b16d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:15.884888 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2a1676fe-07f1-440e-88ea-6417f174b16d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:15.885325 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2a1676fe-07f1-440e-88ea-6417f174b16d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:16.013146 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-2a1676fe-07f1-440e-88ea-6417f174b16d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:16.020863 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-2a1676fe-07f1-440e-88ea-6417f174b16d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380" status: 200 len: 1365 microversion: 2.1 time: 0.148139 Jun 27 09:41:16.025988 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 321/666] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:15 2022] GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:16.879415 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-1d155f3a-a535-4a35-a0ba-39430551fd23 req-a42962f7-072c-4c6e-9654-3968d6583264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f57aa8-bd53-4836-97d8-44a90cfb3380", "name": "network-vif-plugged", "status": "completed", "tag": "a2d19843-8e0c-4622-9baa-515a05143fb7"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:41:16.888717 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-1d155f3a-a535-4a35-a0ba-39430551fd23 req-a42962f7-072c-4c6e-9654-3968d6583264 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:16.889158 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-1d155f3a-a535-4a35-a0ba-39430551fd23 req-a42962f7-072c-4c6e-9654-3968d6583264 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:16.900637 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-1d155f3a-a535-4a35-a0ba-39430551fd23 req-a42962f7-072c-4c6e-9654-3968d6583264 service nova] Creating event network-vif-plugged:a2d19843-8e0c-4622-9baa-515a05143fb7 for instance 70f57aa8-bd53-4836-97d8-44a90cfb3380 on hv-cinder-84773 Jun 27 09:41:16.905022 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-1d155f3a-a535-4a35-a0ba-39430551fd23 req-a42962f7-072c-4c6e-9654-3968d6583264 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029341 Jun 27 09:41:16.905628 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 346/667] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:41:17.037931 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-921c704b-528d-4058-bacc-504e987204ab tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:17.038702 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-921c704b-528d-4058-bacc-504e987204ab tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:17.045683 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-921c704b-528d-4058-bacc-504e987204ab tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:17.046131 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-921c704b-528d-4058-bacc-504e987204ab tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:17.046904 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-921c704b-528d-4058-bacc-504e987204ab tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:17.047337 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-921c704b-528d-4058-bacc-504e987204ab tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:17.190471 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-921c704b-528d-4058-bacc-504e987204ab tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:17.198336 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-921c704b-528d-4058-bacc-504e987204ab tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380" status: 200 len: 1365 microversion: 2.1 time: 0.164377 Jun 27 09:41:17.198903 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 322/668] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:17 2022] GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:18.216605 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-81c9bd08-f41f-4ebe-a491-09b62995ce03 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:18.217301 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-81c9bd08-f41f-4ebe-a491-09b62995ce03 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:18.223581 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-81c9bd08-f41f-4ebe-a491-09b62995ce03 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:18.224032 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-81c9bd08-f41f-4ebe-a491-09b62995ce03 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:18.224791 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-81c9bd08-f41f-4ebe-a491-09b62995ce03 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:18.225254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-81c9bd08-f41f-4ebe-a491-09b62995ce03 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:18.362651 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-81c9bd08-f41f-4ebe-a491-09b62995ce03 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:18.370125 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-81c9bd08-f41f-4ebe-a491-09b62995ce03 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380" status: 200 len: 1365 microversion: 2.1 time: 0.158926 Jun 27 09:41:18.370683 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 347/669] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:18 2022] GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:19.325474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-255c6428-3805-497c-bfc3-6929a60b7873 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:19.326017 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-255c6428-3805-497c-bfc3-6929a60b7873 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:19.328399 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=2 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:19.329072 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=6 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:19.333964 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-255c6428-3805-497c-bfc3-6929a60b7873 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:19.334400 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-255c6428-3805-497c-bfc3-6929a60b7873 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:19.335164 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-255c6428-3805-497c-bfc3-6929a60b7873 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:19.335718 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-255c6428-3805-497c-bfc3-6929a60b7873 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:19.386096 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-cd8a7347-cd5e-437c-890e-34e28e9e2527 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:19.386709 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-cd8a7347-cd5e-437c-890e-34e28e9e2527 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:19.388783 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell0:SELECT=6 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:19.394393 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-cd8a7347-cd5e-437c-890e-34e28e9e2527 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:19.394820 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-cd8a7347-cd5e-437c-890e-34e28e9e2527 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:19.395624 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-cd8a7347-cd5e-437c-890e-34e28e9e2527 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:19.396067 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-cd8a7347-cd5e-437c-890e-34e28e9e2527 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:19.419899 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.objects.instance [None req-255c6428-3805-497c-bfc3-6929a60b7873 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lazy-loading 'services' on Instance uuid bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 {{(pid=124870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:41:19.525936 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-cd8a7347-cd5e-437c-890e-34e28e9e2527 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:19.533366 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-cd8a7347-cd5e-437c-890e-34e28e9e2527 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380" status: 200 len: 1555 microversion: 2.1 time: 0.151174 Jun 27 09:41:19.533924 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 348/670] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:19 2022] GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:19.550175 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-bf549c18-2db7-4976-9b01-8ebce3fe5a48 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:19.550671 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-bf549c18-2db7-4976-9b01-8ebce3fe5a48 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:19.556884 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-bf549c18-2db7-4976-9b01-8ebce3fe5a48 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:19.557337 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-bf549c18-2db7-4976-9b01-8ebce3fe5a48 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:19.558103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-bf549c18-2db7-4976-9b01-8ebce3fe5a48 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:19.558544 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-bf549c18-2db7-4976-9b01-8ebce3fe5a48 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:19.625032 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-255c6428-3805-497c-bfc3-6929a60b7873 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "DELETE /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3/os-volume_attachments/8dd4a5f5-3f56-4b91-9544-ecb781fa03fe" status: 202 len: 0 microversion: 2.1 time: 0.306148 Jun 27 09:41:19.625874 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 323/671] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jun 27 09:41:19 2022] DELETE /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3/os-volume_attachments/8dd4a5f5-3f56-4b91-9544-ecb781fa03fe => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:41:19.636614 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-bf549c18-2db7-4976-9b01-8ebce3fe5a48 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090165 Jun 27 09:41:19.637387 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 349/672] 10.222.0.64 () {58 vars in 1274 bytes} [Mon Jun 27 09:41:19 2022] GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:41:19.637501 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-2c07fcc9-c992-4068-938b-d1c38b3bf723 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:19.638589 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-2c07fcc9-c992-4068-938b-d1c38b3bf723 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:19.644777 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2c07fcc9-c992-4068-938b-d1c38b3bf723 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:19.645372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2c07fcc9-c992-4068-938b-d1c38b3bf723 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:19.646283 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2c07fcc9-c992-4068-938b-d1c38b3bf723 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:19.646724 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2c07fcc9-c992-4068-938b-d1c38b3bf723 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:19.677959 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-2c07fcc9-c992-4068-938b-d1c38b3bf723 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047297 Jun 27 09:41:19.678437 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 324/673] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 27 09:41:19 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:41:20.689569 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f7eb4fa0-a8fa-43f5-8bd0-febc14257671 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:20.690493 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-f7eb4fa0-a8fa-43f5-8bd0-febc14257671 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:20.697020 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f7eb4fa0-a8fa-43f5-8bd0-febc14257671 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:20.697467 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f7eb4fa0-a8fa-43f5-8bd0-febc14257671 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:20.698253 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f7eb4fa0-a8fa-43f5-8bd0-febc14257671 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:20.698910 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f7eb4fa0-a8fa-43f5-8bd0-febc14257671 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:20.704057 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:20.730377 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-f7eb4fa0-a8fa-43f5-8bd0-febc14257671 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045286 Jun 27 09:41:20.730943 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 350/674] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 27 09:41:20 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 09:41:20.814234 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-606b734d-ba53-46a4-b4cd-c45782dd6498 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:20.814800 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-606b734d-ba53-46a4-b4cd-c45782dd6498 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:20.821378 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-606b734d-ba53-46a4-b4cd-c45782dd6498 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:20.821869 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-606b734d-ba53-46a4-b4cd-c45782dd6498 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:20.822645 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-606b734d-ba53-46a4-b4cd-c45782dd6498 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:20.823106 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-606b734d-ba53-46a4-b4cd-c45782dd6498 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:20.851866 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-606b734d-ba53-46a4-b4cd-c45782dd6498 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Going to try to terminate instance {{(pid=124870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 09:41:20.877097 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-921394db-970e-4cb4-b636-e88312dd211e req-88d8a2d4-f052-4972-a0a4-40c0c986cc9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70f57aa8-bd53-4836-97d8-44a90cfb3380", "tag": "a2d19843-8e0c-4622-9baa-515a05143fb7"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:41:20.885638 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-921394db-970e-4cb4-b636-e88312dd211e req-88d8a2d4-f052-4972-a0a4-40c0c986cc9e service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:20.886093 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-921394db-970e-4cb4-b636-e88312dd211e req-88d8a2d4-f052-4972-a0a4-40c0c986cc9e service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:20.889985 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:20.897286 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-921394db-970e-4cb4-b636-e88312dd211e req-88d8a2d4-f052-4972-a0a4-40c0c986cc9e service nova] Creating event network-changed:a2d19843-8e0c-4622-9baa-515a05143fb7 for instance 70f57aa8-bd53-4836-97d8-44a90cfb3380 on hv-cinder-84773 Jun 27 09:41:20.903003 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-921394db-970e-4cb4-b636-e88312dd211e req-88d8a2d4-f052-4972-a0a4-40c0c986cc9e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029887 Jun 27 09:41:20.903634 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 351/675] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:41:21.214793 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-606b734d-ba53-46a4-b4cd-c45782dd6498 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "DELETE /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 204 len: 0 microversion: 2.1 time: 0.404062 Jun 27 09:41:21.218559 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 325/676] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:41:20 2022] DELETE /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 09:41:21.224752 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-28330309-c6bd-43fe-9261-9a510d51e859 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:21.225439 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-28330309-c6bd-43fe-9261-9a510d51e859 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:21.232212 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-28330309-c6bd-43fe-9261-9a510d51e859 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:21.232718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-28330309-c6bd-43fe-9261-9a510d51e859 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:21.233960 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-28330309-c6bd-43fe-9261-9a510d51e859 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:21.233960 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-28330309-c6bd-43fe-9261-9a510d51e859 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:21.365222 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-28330309-c6bd-43fe-9261-9a510d51e859 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:21.373071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-28330309-c6bd-43fe-9261-9a510d51e859 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1691 microversion: 2.1 time: 0.152996 Jun 27 09:41:21.373650 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 352/677] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:21 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:22.391277 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a444fc88-a3eb-4409-8743-1c0e9daa51ea tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:22.391996 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-a444fc88-a3eb-4409-8743-1c0e9daa51ea tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:22.398469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a444fc88-a3eb-4409-8743-1c0e9daa51ea tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:22.398918 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a444fc88-a3eb-4409-8743-1c0e9daa51ea tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:22.400257 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a444fc88-a3eb-4409-8743-1c0e9daa51ea tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:22.400702 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a444fc88-a3eb-4409-8743-1c0e9daa51ea tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:22.525936 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a444fc88-a3eb-4409-8743-1c0e9daa51ea tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:22.533230 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-a444fc88-a3eb-4409-8743-1c0e9daa51ea tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1691 microversion: 2.1 time: 0.146531 Jun 27 09:41:22.533785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 326/678] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:22 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1691 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:23.550135 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-34fae91d-e933-4643-a38d-b64f7e7b5535 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:23.550652 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-34fae91d-e933-4643-a38d-b64f7e7b5535 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:23.557747 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-34fae91d-e933-4643-a38d-b64f7e7b5535 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:23.558199 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-34fae91d-e933-4643-a38d-b64f7e7b5535 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:23.558963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-34fae91d-e933-4643-a38d-b64f7e7b5535 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:23.559405 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-34fae91d-e933-4643-a38d-b64f7e7b5535 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:23.687331 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-34fae91d-e933-4643-a38d-b64f7e7b5535 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:23.694731 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-34fae91d-e933-4643-a38d-b64f7e7b5535 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1691 microversion: 2.1 time: 0.148504 Jun 27 09:41:23.695294 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 353/679] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:23 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1691 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:24.711784 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-680d18ac-0d90-405f-b343-6ac55697d295 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:24.712400 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-680d18ac-0d90-405f-b343-6ac55697d295 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:24.719159 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-680d18ac-0d90-405f-b343-6ac55697d295 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:24.719646 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-680d18ac-0d90-405f-b343-6ac55697d295 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:24.720417 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-680d18ac-0d90-405f-b343-6ac55697d295 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:24.720857 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-680d18ac-0d90-405f-b343-6ac55697d295 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:24.936399 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-680d18ac-0d90-405f-b343-6ac55697d295 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:24.943904 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-680d18ac-0d90-405f-b343-6ac55697d295 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1691 microversion: 2.1 time: 0.236043 Jun 27 09:41:24.944465 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 327/680] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:24 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1691 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:25.661507 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-4073fd64-73e6-4c78-b573-feff015d56d0 req-83378d5e-031f-430c-a8e1-448217e1c07f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3", "name": "network-vif-deleted", "tag": "b082c8ad-e4de-4a60-b4fe-8c92c80f4c32"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:41:25.675412 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-4073fd64-73e6-4c78-b573-feff015d56d0 req-83378d5e-031f-430c-a8e1-448217e1c07f service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:25.675795 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-4073fd64-73e6-4c78-b573-feff015d56d0 req-83378d5e-031f-430c-a8e1-448217e1c07f service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:25.686885 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-4073fd64-73e6-4c78-b573-feff015d56d0 req-83378d5e-031f-430c-a8e1-448217e1c07f service nova] Creating event network-vif-deleted:b082c8ad-e4de-4a60-b4fe-8c92c80f4c32 for instance bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 on hv-cinder-84773 Jun 27 09:41:25.691759 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-4073fd64-73e6-4c78-b573-feff015d56d0 req-83378d5e-031f-430c-a8e1-448217e1c07f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033879 Jun 27 09:41:25.692349 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 354/681] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:41:25.960986 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-39e45ed6-0801-431c-a9f1-0352b484bee5 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:25.961615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-39e45ed6-0801-431c-a9f1-0352b484bee5 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:25.967971 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-39e45ed6-0801-431c-a9f1-0352b484bee5 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:25.968417 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-39e45ed6-0801-431c-a9f1-0352b484bee5 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:25.969178 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-39e45ed6-0801-431c-a9f1-0352b484bee5 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:25.969599 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-39e45ed6-0801-431c-a9f1-0352b484bee5 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:26.036425 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-39e45ed6-0801-431c-a9f1-0352b484bee5 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:26.044456 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-39e45ed6-0801-431c-a9f1-0352b484bee5 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 200 len: 1331 microversion: 2.1 time: 0.087314 Jun 27 09:41:26.045028 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 328/682] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:25 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 1331 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:27.062430 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-11dbd5ce-2c8f-4e0f-96fc-91ccea3f49d9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:27.063139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-11dbd5ce-2c8f-4e0f-96fc-91ccea3f49d9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:27.069299 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-11dbd5ce-2c8f-4e0f-96fc-91ccea3f49d9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:27.069743 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-11dbd5ce-2c8f-4e0f-96fc-91ccea3f49d9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:27.070493 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-11dbd5ce-2c8f-4e0f-96fc-91ccea3f49d9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:27.070919 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-11dbd5ce-2c8f-4e0f-96fc-91ccea3f49d9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:27.090193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-11dbd5ce-2c8f-4e0f-96fc-91ccea3f49d9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] HTTP exception thrown: Instance bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 could not be found. Jun 27 09:41:27.090193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-11dbd5ce-2c8f-4e0f-96fc-91ccea3f49d9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Request method failure captured: Jun 27 09:41:27.090193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 HTTP/1.1 Jun 27 09:41:27.090193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:41:27.090193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:41:27.090193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:41:27.090193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:41:27.090193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:41:27.090193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:41:27.090193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:41:27.090193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:41:27.090193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXoPyTpqQqQHvEElWGjR7DZfAmEwMaudWgOazSbx2lM_fxgthBdxySIgz7_EK2myInpHOrYmO4EeBjzzrfGUjrdY5JcAdZnmqsf8z8_6nkg-QB70l4Rpm-gz_ByA_m8spfp5LU3dJlIbE7yw9ImfGdmloDzbo3Xb15bpRLxuPuS5CEY Jun 27 09:41:27.090193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:41:27.090193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:41:27.090193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:41:27.090193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:41:27.090193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:41:27.090193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:41:27.090193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: 6a50c1d09d3247728aa1ef9fb69463fc Jun 27 09:41:27.090193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1711375648 Jun 27 09:41:27.090193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:41:27.090193 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:41:27.091833 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a50c1d09d3247728aa1ef9fb69463fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a50c1d09d3247728aa1ef9fb69463fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6a50c1d09d3247728aa1ef9fb69463fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6a50c1d09d3247728aa1ef9fb69463fc", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:41:27.091833 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1711375648 Jun 27 09:41:27.091833 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: 6a50c1d09d3247728aa1ef9fb69463fc Jun 27 09:41:27.091833 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1711375648 Jun 27 09:41:27.091833 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-ServerRescueNegativeTestJSON-1711375648-project Jun 27 09:41:27.091833 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:41:27.091833 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:41:27.091833 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: 41ce5cc7ff504d64aac73e48097a4b01 Jun 27 09:41:27.091833 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1711375648-project Jun 27 09:41:27.091833 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: > Jun 27 09:41:27.091833 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Instance bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 could not be found. Jun 27 09:41:27.091833 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'id': 'bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3'} Jun 27 09:41:27.092723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:41:27.092723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:41:27.092723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:41:27.092723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:41:27.092723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:41:27.092723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:41:27.092723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:41:27.092723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:41:27.092723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:41:27.092723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:41:27.092723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 could not be found. Jun 27 09:41:27.092723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:41:27.092723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:41:27.092723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:41:27.092723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:41:27.092723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:41:27.092723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:41:27.092723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:41:27.092723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:41:27.092723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:41:27.094110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:41:27.094110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:41:27.094110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:41:27.094110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:41:27.094110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:41:27.094110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:41:27.094110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:41:27.094110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 could not be found. Jun 27 09:41:27.094110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:41:27.094110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:41:27.094110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:41:27.094110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:41:27.094110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:41:27.094110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:41:27.094110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:41:27.094110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:41:27.094110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 could not be found. Jun 27 09:41:27.094110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:41:27.095516 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-11dbd5ce-2c8f-4e0f-96fc-91ccea3f49d9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Returning 404 to user: Instance bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:41:27.095516 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-11dbd5ce-2c8f-4e0f-96fc-91ccea3f49d9 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3" status: 404 len: 111 microversion: 2.1 time: 0.029391 Jun 27 09:41:27.095516 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 355/683] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:27 2022] GET /compute/v2.1/servers/bd0f2fbd-b464-4b53-a2e3-a3c674fd04f3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:41:27.096492 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-f86ff7be-983b-4412-a5e2-6cccd44db864 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '.version_select at 0x7ffa9742ff70>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:27.174532 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-f86ff7be-983b-4412-a5e2-6cccd44db864 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1718551329" status: 202 len: 0 microversion: 2.1 time: 0.081803 Jun 27 09:41:27.175098 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 329/684] 10.222.0.64 () {58 vars in 1220 bytes} [Mon Jun 27 09:41:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1718551329 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 09:41:30.476744 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-70254a29-61cb-4a7d-a56c-6d13797d4458 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:30.477220 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-70254a29-61cb-4a7d-a56c-6d13797d4458 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:30.483698 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-70254a29-61cb-4a7d-a56c-6d13797d4458 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:30.484136 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-70254a29-61cb-4a7d-a56c-6d13797d4458 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:30.484885 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-70254a29-61cb-4a7d-a56c-6d13797d4458 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:30.485314 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-70254a29-61cb-4a7d-a56c-6d13797d4458 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:30.510499 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-70254a29-61cb-4a7d-a56c-6d13797d4458 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Going to try to terminate instance {{(pid=124869) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 09:41:30.739451 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-70254a29-61cb-4a7d-a56c-6d13797d4458 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "DELETE /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 204 len: 0 microversion: 2.1 time: 0.266169 Jun 27 09:41:30.740059 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 356/685] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:41:30 2022] DELETE /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 09:41:30.748676 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a4681959-34ec-4221-9a6e-f5fc2722e24f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:30.749318 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-a4681959-34ec-4221-9a6e-f5fc2722e24f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:30.755461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a4681959-34ec-4221-9a6e-f5fc2722e24f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:30.755942 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a4681959-34ec-4221-9a6e-f5fc2722e24f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:30.757170 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a4681959-34ec-4221-9a6e-f5fc2722e24f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:30.757170 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a4681959-34ec-4221-9a6e-f5fc2722e24f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:30.889122 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a4681959-34ec-4221-9a6e-f5fc2722e24f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:30.896620 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-a4681959-34ec-4221-9a6e-f5fc2722e24f tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1508 microversion: 2.1 time: 0.152473 Jun 27 09:41:30.897189 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 330/686] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:30 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:41:31.914077 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-09dfd7de-4ff8-4923-95d8-7ed827b56651 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:31.914711 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-09dfd7de-4ff8-4923-95d8-7ed827b56651 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:31.917415 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:31.922291 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-09dfd7de-4ff8-4923-95d8-7ed827b56651 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:31.922742 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-09dfd7de-4ff8-4923-95d8-7ed827b56651 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:31.923518 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-09dfd7de-4ff8-4923-95d8-7ed827b56651 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:31.923983 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-09dfd7de-4ff8-4923-95d8-7ed827b56651 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:32.054413 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-09dfd7de-4ff8-4923-95d8-7ed827b56651 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:32.060645 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-09dfd7de-4ff8-4923-95d8-7ed827b56651 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1508 microversion: 2.1 time: 0.150864 Jun 27 09:41:32.061211 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 357/687] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:31 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:33.078260 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-bb1d07ea-73fc-45cd-b89d-e1574041ee46 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:33.078875 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-bb1d07ea-73fc-45cd-b89d-e1574041ee46 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:33.081334 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:33.086209 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-bb1d07ea-73fc-45cd-b89d-e1574041ee46 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:33.086663 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-bb1d07ea-73fc-45cd-b89d-e1574041ee46 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:33.087428 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-bb1d07ea-73fc-45cd-b89d-e1574041ee46 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:33.088747 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-bb1d07ea-73fc-45cd-b89d-e1574041ee46 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:33.216251 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-bb1d07ea-73fc-45cd-b89d-e1574041ee46 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:33.223544 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-bb1d07ea-73fc-45cd-b89d-e1574041ee46 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1508 microversion: 2.1 time: 0.149376 Jun 27 09:41:33.226942 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 331/688] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:33 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:33.840667 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-b6cf2266-042d-4761-a808-5e6321ce335e req-64792828-ead8-4158-884e-99db0acdaea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9", "name": "network-vif-deleted", "tag": "cb15c03b-d1f2-488e-baae-86a39cab937b"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:41:33.848891 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-b6cf2266-042d-4761-a808-5e6321ce335e req-64792828-ead8-4158-884e-99db0acdaea1 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:33.850039 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-b6cf2266-042d-4761-a808-5e6321ce335e req-64792828-ead8-4158-884e-99db0acdaea1 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:33.860700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-b6cf2266-042d-4761-a808-5e6321ce335e req-64792828-ead8-4158-884e-99db0acdaea1 service nova] Creating event network-vif-deleted:cb15c03b-d1f2-488e-baae-86a39cab937b for instance 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 on hv-cinder-84773 Jun 27 09:41:33.865645 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-b6cf2266-042d-4761-a808-5e6321ce335e req-64792828-ead8-4158-884e-99db0acdaea1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089897 Jun 27 09:41:33.866446 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 358/689] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:41:34.240054 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-26f9c7ce-d1de-4d1b-9252-3b0b7e9a7387 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:34.240669 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-26f9c7ce-d1de-4d1b-9252-3b0b7e9a7387 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:34.247080 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-26f9c7ce-d1de-4d1b-9252-3b0b7e9a7387 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:34.247552 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-26f9c7ce-d1de-4d1b-9252-3b0b7e9a7387 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:34.248318 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-26f9c7ce-d1de-4d1b-9252-3b0b7e9a7387 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:34.248768 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-26f9c7ce-d1de-4d1b-9252-3b0b7e9a7387 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:34.279874 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-26f9c7ce-d1de-4d1b-9252-3b0b7e9a7387 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:34.280332 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-26f9c7ce-d1de-4d1b-9252-3b0b7e9a7387 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:34.280780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.objects.instance [None req-26f9c7ce-d1de-4d1b-9252-3b0b7e9a7387 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lazy-loading 'fault' on Instance uuid 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 {{(pid=124870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:41:34.324151 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-26f9c7ce-d1de-4d1b-9252-3b0b7e9a7387 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:34.331523 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-26f9c7ce-d1de-4d1b-9252-3b0b7e9a7387 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 200 len: 1312 microversion: 2.1 time: 0.095762 Jun 27 09:41:34.332096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 332/690] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:34 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:35.351031 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-54b28092-ca64-4123-bb01-a49da3406911 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:35.351753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-54b28092-ca64-4123-bb01-a49da3406911 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:35.358353 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-54b28092-ca64-4123-bb01-a49da3406911 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:35.358796 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-54b28092-ca64-4123-bb01-a49da3406911 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:35.359573 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-54b28092-ca64-4123-bb01-a49da3406911 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:35.360012 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-54b28092-ca64-4123-bb01-a49da3406911 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:35.373416 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-54b28092-ca64-4123-bb01-a49da3406911 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] HTTP exception thrown: Instance 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 could not be found. Jun 27 09:41:35.375002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-54b28092-ca64-4123-bb01-a49da3406911 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Request method failure captured: Jun 27 09:41:35.375002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 HTTP/1.1 Jun 27 09:41:35.375002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:41:35.375002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:41:35.375002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:41:35.375002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:41:35.375002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:41:35.375002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:41:35.375002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:41:35.375002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:41:35.375002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXoPyTpqQqQHvEElWGjR7DZfAmEwMaudWgOazSbx2lM_fxgthBdxySIgz7_EK2myInpHOrYmO4EeBjzzrfGUjrdY5JcAdZnmqsf8z8_6nkg-QB70l4Rpm-gz_ByA_m8spfp5LU3dJlIbE7yw9ImfGdmloDzbo3Xb15bpRLxuPuS5CEY Jun 27 09:41:35.375002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:41:35.375002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:41:35.375002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:41:35.375002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:41:35.375002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:41:35.375002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:41:35.375002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: 6a50c1d09d3247728aa1ef9fb69463fc Jun 27 09:41:35.375002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1711375648 Jun 27 09:41:35.375002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:41:35.375002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:41:35.376360 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a50c1d09d3247728aa1ef9fb69463fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a50c1d09d3247728aa1ef9fb69463fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6a50c1d09d3247728aa1ef9fb69463fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6a50c1d09d3247728aa1ef9fb69463fc", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:41:35.376360 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1711375648 Jun 27 09:41:35.376360 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: 6a50c1d09d3247728aa1ef9fb69463fc Jun 27 09:41:35.376360 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1711375648 Jun 27 09:41:35.376360 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-ServerRescueNegativeTestJSON-1711375648-project Jun 27 09:41:35.376360 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:41:35.376360 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:41:35.376360 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: 41ce5cc7ff504d64aac73e48097a4b01 Jun 27 09:41:35.376360 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1711375648-project Jun 27 09:41:35.376360 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: > Jun 27 09:41:35.376360 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Instance 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 could not be found. Jun 27 09:41:35.376360 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'id': '03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9'} Jun 27 09:41:35.377108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:41:35.377108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:41:35.377108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:41:35.377108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:41:35.377108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:41:35.377108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:41:35.377108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:41:35.377108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:41:35.377108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:41:35.377108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:41:35.377108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 could not be found. Jun 27 09:41:35.377108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:41:35.377108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:41:35.377108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:41:35.377108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:41:35.377108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:41:35.377108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:41:35.377108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:41:35.377108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:41:35.377108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:41:35.378718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:41:35.378718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:41:35.378718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:41:35.378718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:41:35.378718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:41:35.378718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:41:35.378718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:41:35.378718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 could not be found. Jun 27 09:41:35.378718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:41:35.378718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:41:35.378718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:41:35.378718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:41:35.378718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:41:35.378718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:41:35.378718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:41:35.378718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:41:35.378718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 could not be found. Jun 27 09:41:35.378718 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:41:35.380053 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-54b28092-ca64-4123-bb01-a49da3406911 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Returning 404 to user: Instance 03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:41:35.380053 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-54b28092-ca64-4123-bb01-a49da3406911 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9" status: 404 len: 111 microversion: 2.1 time: 0.030023 Jun 27 09:41:35.380053 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 359/691] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:35 2022] GET /compute/v2.1/servers/03b66e4d-cd03-4ac2-9cf2-c3c6a49e89f9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:41:35.384719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-2504adf8-cae0-4728-8cf2-67c079a2fca7 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:35.385212 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-2504adf8-cae0-4728-8cf2-67c079a2fca7 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:35.391643 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2504adf8-cae0-4728-8cf2-67c079a2fca7 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:35.392083 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2504adf8-cae0-4728-8cf2-67c079a2fca7 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:35.392840 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2504adf8-cae0-4728-8cf2-67c079a2fca7 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:35.393272 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2504adf8-cae0-4728-8cf2-67c079a2fca7 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:35.417586 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-2504adf8-cae0-4728-8cf2-67c079a2fca7 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Going to try to terminate instance {{(pid=124870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 09:41:35.800987 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-2504adf8-cae0-4728-8cf2-67c079a2fca7 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 204 len: 0 microversion: 2.1 time: 0.419776 Jun 27 09:41:35.801567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 333/692] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:41:35 2022] DELETE /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 09:41:35.809474 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-750db7a9-1872-4cd2-bfad-456969a90b6a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:35.810833 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-750db7a9-1872-4cd2-bfad-456969a90b6a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:35.816346 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-750db7a9-1872-4cd2-bfad-456969a90b6a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:35.816843 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-750db7a9-1872-4cd2-bfad-456969a90b6a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:35.817593 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-750db7a9-1872-4cd2-bfad-456969a90b6a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:35.818023 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-750db7a9-1872-4cd2-bfad-456969a90b6a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:35.948287 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-750db7a9-1872-4cd2-bfad-456969a90b6a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:35.955574 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-750db7a9-1872-4cd2-bfad-456969a90b6a tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.149970 Jun 27 09:41:35.956128 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 360/693] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:35 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:36.973697 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-0b068df4-d4c5-42f4-94ad-da2c0de302be tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:36.974392 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-0b068df4-d4c5-42f4-94ad-da2c0de302be tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:36.981381 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0b068df4-d4c5-42f4-94ad-da2c0de302be tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:36.981829 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0b068df4-d4c5-42f4-94ad-da2c0de302be tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:36.982591 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0b068df4-d4c5-42f4-94ad-da2c0de302be tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:36.983028 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0b068df4-d4c5-42f4-94ad-da2c0de302be tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:37.113910 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-0b068df4-d4c5-42f4-94ad-da2c0de302be tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:37.122071 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-0b068df4-d4c5-42f4-94ad-da2c0de302be tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.152592 Jun 27 09:41:37.122656 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 334/694] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:36 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:38.138749 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-b7c26b46-e75f-41b3-ab9d-01d20c150c1c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:38.139393 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-b7c26b46-e75f-41b3-ab9d-01d20c150c1c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:38.146023 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b7c26b46-e75f-41b3-ab9d-01d20c150c1c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:38.146475 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b7c26b46-e75f-41b3-ab9d-01d20c150c1c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:38.147242 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b7c26b46-e75f-41b3-ab9d-01d20c150c1c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:38.147713 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b7c26b46-e75f-41b3-ab9d-01d20c150c1c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:38.272785 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-b7c26b46-e75f-41b3-ab9d-01d20c150c1c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:38.280223 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-b7c26b46-e75f-41b3-ab9d-01d20c150c1c tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.145937 Jun 27 09:41:38.280813 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 361/695] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:38 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:39.296970 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-737bfe66-19a3-4cce-b3c5-e153d1d727dd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:39.297546 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-737bfe66-19a3-4cce-b3c5-e153d1d727dd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:39.304142 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-737bfe66-19a3-4cce-b3c5-e153d1d727dd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:39.304602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-737bfe66-19a3-4cce-b3c5-e153d1d727dd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:39.305371 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-737bfe66-19a3-4cce-b3c5-e153d1d727dd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:39.305811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-737bfe66-19a3-4cce-b3c5-e153d1d727dd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:39.500180 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-737bfe66-19a3-4cce-b3c5-e153d1d727dd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:39.508267 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-737bfe66-19a3-4cce-b3c5-e153d1d727dd tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1521 microversion: 2.1 time: 0.214866 Jun 27 09:41:39.508916 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 335/696] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:39 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:39.926116 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-117072ec-d92a-4abf-af37-0f3670e69d68 req-e47cc15f-c400-4c3c-a349-ef636aa3729a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7744db71-f29c-4221-af51-e3688c4fbc97", "name": "network-vif-deleted", "tag": "9720d11f-73fc-4566-a281-54fa01d4bc65"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:41:39.935433 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-117072ec-d92a-4abf-af37-0f3670e69d68 req-e47cc15f-c400-4c3c-a349-ef636aa3729a service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:39.936529 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-117072ec-d92a-4abf-af37-0f3670e69d68 req-e47cc15f-c400-4c3c-a349-ef636aa3729a service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:39.946921 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-117072ec-d92a-4abf-af37-0f3670e69d68 req-e47cc15f-c400-4c3c-a349-ef636aa3729a service nova] Creating event network-vif-deleted:9720d11f-73fc-4566-a281-54fa01d4bc65 for instance 7744db71-f29c-4221-af51-e3688c4fbc97 on hv-cinder-84773 Jun 27 09:41:39.951768 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-117072ec-d92a-4abf-af37-0f3670e69d68 req-e47cc15f-c400-4c3c-a349-ef636aa3729a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029295 Jun 27 09:41:39.952349 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 362/697] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:41:40.526107 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-691229a0-3532-40c9-95d5-9825fb55aa3e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:40.527359 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-691229a0-3532-40c9-95d5-9825fb55aa3e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:40.534206 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-691229a0-3532-40c9-95d5-9825fb55aa3e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:40.534661 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-691229a0-3532-40c9-95d5-9825fb55aa3e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:40.535431 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-691229a0-3532-40c9-95d5-9825fb55aa3e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:40.535892 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-691229a0-3532-40c9-95d5-9825fb55aa3e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:40.568754 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-691229a0-3532-40c9-95d5-9825fb55aa3e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:40.569200 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-691229a0-3532-40c9-95d5-9825fb55aa3e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:40.569649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.objects.instance [None req-691229a0-3532-40c9-95d5-9825fb55aa3e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lazy-loading 'fault' on Instance uuid 7744db71-f29c-4221-af51-e3688c4fbc97 {{(pid=124870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:41:40.609924 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-691229a0-3532-40c9-95d5-9825fb55aa3e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ce5cc7ff504d64aac73e48097a4b01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a50c1d09d3247728aa1ef9fb69463fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:40.617405 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-691229a0-3532-40c9-95d5-9825fb55aa3e tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 200 len: 1311 microversion: 2.1 time: 0.095442 Jun 27 09:41:40.617967 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 336/698] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:40 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:41.635466 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e048115c-cb4f-4d2c-8410-e3f6a0a83c03 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:41.636240 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-e048115c-cb4f-4d2c-8410-e3f6a0a83c03 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] [instance: 7744db71-f29c-4221-af51-e3688c4fbc97] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:41.642445 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e048115c-cb4f-4d2c-8410-e3f6a0a83c03 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:41.642894 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e048115c-cb4f-4d2c-8410-e3f6a0a83c03 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:41.643695 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e048115c-cb4f-4d2c-8410-e3f6a0a83c03 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:41.644136 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e048115c-cb4f-4d2c-8410-e3f6a0a83c03 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:41.657627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-e048115c-cb4f-4d2c-8410-e3f6a0a83c03 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] HTTP exception thrown: Instance 7744db71-f29c-4221-af51-e3688c4fbc97 could not be found. Jun 27 09:41:41.659201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e048115c-cb4f-4d2c-8410-e3f6a0a83c03 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Request method failure captured: Jun 27 09:41:41.659201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 HTTP/1.1 Jun 27 09:41:41.659201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:41:41.659201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:41:41.659201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:41:41.659201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:41:41.659201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:41:41.659201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:41:41.659201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:41:41.659201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:41:41.659201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXoPyTpqQqQHvEElWGjR7DZfAmEwMaudWgOazSbx2lM_fxgthBdxySIgz7_EK2myInpHOrYmO4EeBjzzrfGUjrdY5JcAdZnmqsf8z8_6nkg-QB70l4Rpm-gz_ByA_m8spfp5LU3dJlIbE7yw9ImfGdmloDzbo3Xb15bpRLxuPuS5CEY Jun 27 09:41:41.659201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:41:41.659201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:41:41.659201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:41:41.659201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:41:41.659201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:41:41.659201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:41:41.659201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: 6a50c1d09d3247728aa1ef9fb69463fc Jun 27 09:41:41.659201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1711375648 Jun 27 09:41:41.659201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:41:41.659201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:41:41.660850 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a50c1d09d3247728aa1ef9fb69463fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a50c1d09d3247728aa1ef9fb69463fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6a50c1d09d3247728aa1ef9fb69463fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6a50c1d09d3247728aa1ef9fb69463fc", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:41:41.660850 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1711375648 Jun 27 09:41:41.660850 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: 6a50c1d09d3247728aa1ef9fb69463fc Jun 27 09:41:41.660850 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1711375648 Jun 27 09:41:41.660850 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-ServerRescueNegativeTestJSON-1711375648-project Jun 27 09:41:41.660850 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:41:41.660850 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:41:41.660850 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: 41ce5cc7ff504d64aac73e48097a4b01 Jun 27 09:41:41.660850 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1711375648-project Jun 27 09:41:41.660850 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: > Jun 27 09:41:41.660850 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Instance 7744db71-f29c-4221-af51-e3688c4fbc97 could not be found. Jun 27 09:41:41.660850 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'id': '7744db71-f29c-4221-af51-e3688c4fbc97'} Jun 27 09:41:41.661763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:41:41.661763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:41:41.661763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:41:41.661763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:41:41.661763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:41:41.661763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:41:41.661763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:41:41.661763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:41:41.661763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:41:41.661763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:41:41.661763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7744db71-f29c-4221-af51-e3688c4fbc97 could not be found. Jun 27 09:41:41.661763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:41:41.661763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:41:41.661763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:41:41.661763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:41:41.661763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:41:41.661763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:41:41.661763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:41:41.661763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:41:41.661763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:41:41.663258 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:41:41.663258 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:41:41.663258 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:41:41.663258 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:41:41.663258 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:41:41.663258 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:41:41.663258 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:41:41.663258 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7744db71-f29c-4221-af51-e3688c4fbc97 could not be found. Jun 27 09:41:41.663258 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:41:41.663258 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:41:41.663258 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:41:41.663258 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:41:41.663258 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:41:41.663258 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:41:41.663258 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:41:41.663258 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:41:41.663258 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7744db71-f29c-4221-af51-e3688c4fbc97 could not be found. Jun 27 09:41:41.663258 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:41:41.664648 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e048115c-cb4f-4d2c-8410-e3f6a0a83c03 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] Returning 404 to user: Instance 7744db71-f29c-4221-af51-e3688c4fbc97 could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:41:41.664648 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-e048115c-cb4f-4d2c-8410-e3f6a0a83c03 tempest-ServerRescueNegativeTestJSON-1711375648 tempest-ServerRescueNegativeTestJSON-1711375648-project] 10.222.0.64 "GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97" status: 404 len: 111 microversion: 2.1 time: 0.030128 Jun 27 09:41:41.664648 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 363/699] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:41 2022] GET /compute/v2.1/servers/7744db71-f29c-4221-af51-e3688c4fbc97 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:41:48.286618 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-b6f62ba1-1576-44a6-8310-818005e6eb13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:48.287112 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-b6f62ba1-1576-44a6-8310-818005e6eb13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:48.294196 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b6f62ba1-1576-44a6-8310-818005e6eb13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:48.294651 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b6f62ba1-1576-44a6-8310-818005e6eb13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:48.295421 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b6f62ba1-1576-44a6-8310-818005e6eb13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:48.295930 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b6f62ba1-1576-44a6-8310-818005e6eb13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:48.319448 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-b6f62ba1-1576-44a6-8310-818005e6eb13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c/ips" status: 200 len: 150 microversion: 2.20 time: 0.199937 Jun 27 09:41:48.320052 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 337/700] 10.222.0.64 () {60 vars in 1288 bytes} [Mon Jun 27 09:41:48 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c/ips => generated 150 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 09:41:50.367889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-a0ef27c2-f425-4257-8731-01641e47e1b2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:41:50.368456 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-a0ef27c2-f425-4257-8731-01641e47e1b2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:50.375608 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a0ef27c2-f425-4257-8731-01641e47e1b2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:50.376067 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a0ef27c2-f425-4257-8731-01641e47e1b2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:50.376830 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a0ef27c2-f425-4257-8731-01641e47e1b2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:50.377270 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a0ef27c2-f425-4257-8731-01641e47e1b2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:50.398999 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.objects.instance [None req-a0ef27c2-f425-4257-8731-01641e47e1b2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lazy-loading 'flavor' on Instance uuid 448074d1-f23d-4254-a9ec-26b00bd1298c {{(pid=124869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:41:50.898310 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-0e01329c-e036-4159-adbe-bab8ae3c1a30 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1617501367"}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:41:50.898865 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-0e01329c-e036-4159-adbe-bab8ae3c1a30 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:50.905919 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0e01329c-e036-4159-adbe-bab8ae3c1a30 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:50.906363 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0e01329c-e036-4159-adbe-bab8ae3c1a30 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:50.907121 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0e01329c-e036-4159-adbe-bab8ae3c1a30 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:50.907580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0e01329c-e036-4159-adbe-bab8ae3c1a30 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:50.969232 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-a0ef27c2-f425-4257-8731-01641e47e1b2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "POST /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c/action" status: 202 len: 0 microversion: 2.20 time: 0.605165 Jun 27 09:41:50.970136 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 364/701] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jun 27 09:41:50 2022] POST /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 09:41:50.978703 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-5d9605c5-cc05-4249-b587-e42c5f34142a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:50.979583 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-5d9605c5-cc05-4249-b587-e42c5f34142a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:50.992321 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5d9605c5-cc05-4249-b587-e42c5f34142a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:50.992321 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5d9605c5-cc05-4249-b587-e42c5f34142a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:50.992321 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5d9605c5-cc05-4249-b587-e42c5f34142a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:50.992321 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5d9605c5-cc05-4249-b587-e42c5f34142a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:51.048410 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.network.security_group_api [None req-0e01329c-e036-4159-adbe-bab8ae3c1a30 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Removing security group 75558118-58f1-4617-91d1-20932d4db53c from port b7d364ab-ebca-4312-8213-6c5cc722e7bc Jun 27 09:41:51.131721 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-5d9605c5-cc05-4249-b587-e42c5f34142a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:51.141124 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-5d9605c5-cc05-4249-b587-e42c5f34142a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:51.142765 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-5d9605c5-cc05-4249-b587-e42c5f34142a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:51.143951 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-5d9605c5-cc05-4249-b587-e42c5f34142a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1723 microversion: 2.20 time: 0.169644 Jun 27 09:41:51.144511 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 365/702] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:41:50 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:41:51.503458 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-0e01329c-e036-4159-adbe-bab8ae3c1a30 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "POST /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129/action" status: 202 len: 0 microversion: 2.1 time: 0.605345 Jun 27 09:41:51.503458 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 338/703] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 27 09:41:50 2022] POST /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 09:41:51.508592 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-c07e57da-5aeb-4b15-b247-91a4c9592a15 req-865a7b48-74d5-437e-b616-02f295a53630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129", "tag": "b7d364ab-ebca-4312-8213-6c5cc722e7bc"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:41:51.518437 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-c07e57da-5aeb-4b15-b247-91a4c9592a15 req-865a7b48-74d5-437e-b616-02f295a53630 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:51.524638 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-c07e57da-5aeb-4b15-b247-91a4c9592a15 req-865a7b48-74d5-437e-b616-02f295a53630 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:51.537009 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:51.542766 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-c07e57da-5aeb-4b15-b247-91a4c9592a15 req-865a7b48-74d5-437e-b616-02f295a53630 service nova] Creating event network-changed:b7d364ab-ebca-4312-8213-6c5cc722e7bc for instance b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 on hv-cinder-84773 Jun 27 09:41:51.546816 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-c07e57da-5aeb-4b15-b247-91a4c9592a15 req-865a7b48-74d5-437e-b616-02f295a53630 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041748 Jun 27 09:41:51.550203 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 366/704] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:41:52.164013 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-8d18d4bf-5320-4d7c-a76f-42937fda6dfc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:52.164533 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-8d18d4bf-5320-4d7c-a76f-42937fda6dfc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:52.171428 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8d18d4bf-5320-4d7c-a76f-42937fda6dfc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:52.180824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8d18d4bf-5320-4d7c-a76f-42937fda6dfc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:52.180824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8d18d4bf-5320-4d7c-a76f-42937fda6dfc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:52.180824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-8d18d4bf-5320-4d7c-a76f-42937fda6dfc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:52.460635 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8d18d4bf-5320-4d7c-a76f-42937fda6dfc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:52.462954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:41:52.470032 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8d18d4bf-5320-4d7c-a76f-42937fda6dfc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:52.471550 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-8d18d4bf-5320-4d7c-a76f-42937fda6dfc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:52.472723 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-8d18d4bf-5320-4d7c-a76f-42937fda6dfc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1723 microversion: 2.20 time: 0.313266 Jun 27 09:41:52.473280 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 339/705] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:41:52 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:41:53.378699 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-ec05b0fa-fbf6-4bfb-af7b-9dfe0be125a7 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:53.379448 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-ec05b0fa-fbf6-4bfb-af7b-9dfe0be125a7 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:53.386397 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ec05b0fa-fbf6-4bfb-af7b-9dfe0be125a7 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:53.386844 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ec05b0fa-fbf6-4bfb-af7b-9dfe0be125a7 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:53.387645 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ec05b0fa-fbf6-4bfb-af7b-9dfe0be125a7 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:53.388087 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ec05b0fa-fbf6-4bfb-af7b-9dfe0be125a7 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:53.470144 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.objects.instance [None req-ec05b0fa-fbf6-4bfb-af7b-9dfe0be125a7 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lazy-loading 'services' on Instance uuid b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 {{(pid=124869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:41:53.493443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-d9e8da50-1bf8-40fa-91de-7f39e4099fa8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:53.494893 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-d9e8da50-1bf8-40fa-91de-7f39e4099fa8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:53.501767 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d9e8da50-1bf8-40fa-91de-7f39e4099fa8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:53.502258 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d9e8da50-1bf8-40fa-91de-7f39e4099fa8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:53.503589 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d9e8da50-1bf8-40fa-91de-7f39e4099fa8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:53.504186 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d9e8da50-1bf8-40fa-91de-7f39e4099fa8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:53.655918 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d9e8da50-1bf8-40fa-91de-7f39e4099fa8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:53.664565 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d9e8da50-1bf8-40fa-91de-7f39e4099fa8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:53.666362 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d9e8da50-1bf8-40fa-91de-7f39e4099fa8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:53.667903 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-d9e8da50-1bf8-40fa-91de-7f39e4099fa8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1723 microversion: 2.20 time: 0.180296 Jun 27 09:41:53.668683 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 340/706] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:41:53 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:41:53.678465 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-f72757cd-385b-457c-9ca7-7794638de8ba req-8ad413e1-9ac5-41d5-a477-d73713370149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129", "tag": "b7d364ab-ebca-4312-8213-6c5cc722e7bc"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:41:53.687152 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-f72757cd-385b-457c-9ca7-7794638de8ba req-8ad413e1-9ac5-41d5-a477-d73713370149 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:53.687621 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-f72757cd-385b-457c-9ca7-7794638de8ba req-8ad413e1-9ac5-41d5-a477-d73713370149 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:53.698507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-f72757cd-385b-457c-9ca7-7794638de8ba req-8ad413e1-9ac5-41d5-a477-d73713370149 service nova] Creating event network-changed:b7d364ab-ebca-4312-8213-6c5cc722e7bc for instance b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 on hv-cinder-84773 Jun 27 09:41:53.709456 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-f72757cd-385b-457c-9ca7-7794638de8ba req-8ad413e1-9ac5-41d5-a477-d73713370149 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034471 Jun 27 09:41:53.709456 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 341/707] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:41:53.770222 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-ec05b0fa-fbf6-4bfb-af7b-9dfe0be125a7 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129/os-volume_attachments/49428e7d-b2d7-4ffc-bcab-1b92c5c10c0e" status: 202 len: 0 microversion: 2.1 time: 0.395921 Jun 27 09:41:53.771471 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 367/708] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jun 27 09:41:53 2022] DELETE /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129/os-volume_attachments/49428e7d-b2d7-4ffc-bcab-1b92c5c10c0e => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:41:53.779949 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-0719298c-bc01-4829-81a3-1b78d5b5786f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:53.781065 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-0719298c-bc01-4829-81a3-1b78d5b5786f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:53.789216 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0719298c-bc01-4829-81a3-1b78d5b5786f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:53.789785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0719298c-bc01-4829-81a3-1b78d5b5786f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:53.790679 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0719298c-bc01-4829-81a3-1b78d5b5786f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:53.791224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0719298c-bc01-4829-81a3-1b78d5b5786f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:53.825398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-0719298c-bc01-4829-81a3-1b78d5b5786f tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049748 Jun 27 09:41:53.826137 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 342/709] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 27 09:41:53 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:41:54.687131 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-0fe3d462-c493-4ee8-8170-0673312d5cff tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:54.687856 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-0fe3d462-c493-4ee8-8170-0673312d5cff tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:54.694478 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0fe3d462-c493-4ee8-8170-0673312d5cff tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:54.694932 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0fe3d462-c493-4ee8-8170-0673312d5cff tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:54.695730 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0fe3d462-c493-4ee8-8170-0673312d5cff tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:54.696182 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0fe3d462-c493-4ee8-8170-0673312d5cff tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:54.835127 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-0fe3d462-c493-4ee8-8170-0673312d5cff tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:54.837785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-32efd66f-0210-41dd-bc25-ed5d109c6083 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:54.838760 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-32efd66f-0210-41dd-bc25-ed5d109c6083 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:54.844236 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-0fe3d462-c493-4ee8-8170-0673312d5cff tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:54.846215 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-32efd66f-0210-41dd-bc25-ed5d109c6083 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:54.846678 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-32efd66f-0210-41dd-bc25-ed5d109c6083 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:54.847503 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-32efd66f-0210-41dd-bc25-ed5d109c6083 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:54.847974 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-32efd66f-0210-41dd-bc25-ed5d109c6083 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:54.848575 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-0fe3d462-c493-4ee8-8170-0673312d5cff tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:54.857254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-0fe3d462-c493-4ee8-8170-0673312d5cff tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1723 microversion: 2.20 time: 0.167329 Jun 27 09:41:54.857254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 368/710] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:41:54 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:41:54.876733 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-32efd66f-0210-41dd-bc25-ed5d109c6083 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043235 Jun 27 09:41:54.877287 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 343/711] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 27 09:41:54 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 27 09:41:54.887616 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-16c7dfb0-316e-4e71-9ab9-5ccf72f87df2 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:54.888116 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-16c7dfb0-316e-4e71-9ab9-5ccf72f87df2 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:54.894082 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-16c7dfb0-316e-4e71-9ab9-5ccf72f87df2 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:54.894536 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-16c7dfb0-316e-4e71-9ab9-5ccf72f87df2 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:54.895330 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-16c7dfb0-316e-4e71-9ab9-5ccf72f87df2 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:54.895812 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-16c7dfb0-316e-4e71-9ab9-5ccf72f87df2 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:54.969130 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-16c7dfb0-316e-4e71-9ab9-5ccf72f87df2 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] HTTP exception thrown: Instance b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 is not attached to volume 49428e7d-b2d7-4ffc-bcab-1b92c5c10c0e Jun 27 09:41:54.976494 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-16c7dfb0-316e-4e71-9ab9-5ccf72f87df2 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Request method failure captured: Jun 27 09:41:54.976494 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: DELETE /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129/os-volume_attachments/49428e7d-b2d7-4ffc-bcab-1b92c5c10c0e HTTP/1.1 Jun 27 09:41:54.976494 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:41:54.976494 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:41:54.976494 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:41:54.976494 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:41:54.976494 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:41:54.976494 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:41:54.976494 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:41:54.976494 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:41:54.976494 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXqmMdRWPq1mKl_d5tHzLLG0XsaZor334N9hd2IakFzCV8gMb0xSTqskIPoAVVpScnRJlzH6cTd7cX68us2qHqpwNG2iIPA3j89KUjk4I-VNksnbQNYV09oEebuUq6GUH1DDKulZkIjuewmylB1MyKhzDMItsXOmQdSsrRj4_8iJTf4 Jun 27 09:41:54.976494 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:41:54.976494 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:41:54.976494 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:41:54.976494 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:41:54.976494 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:41:54.976494 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:41:54.976494 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: 55f89ed92a124e2c8a274975bc0935ba Jun 27 09:41:54.976494 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-TestMinimumBasicScenario-1543834741 Jun 27 09:41:54.976494 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:41:54.976494 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:41:54.978140 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/55f89ed92a124e2c8a274975bc0935ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/55f89ed92a124e2c8a274975bc0935ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/55f89ed92a124e2c8a274975bc0935ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_55f89ed92a124e2c8a274975bc0935ba", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:41:54.978140 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-TestMinimumBasicScenario-1543834741 Jun 27 09:41:54.978140 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: 55f89ed92a124e2c8a274975bc0935ba Jun 27 09:41:54.978140 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1543834741 Jun 27 09:41:54.978140 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-TestMinimumBasicScenario-1543834741-project Jun 27 09:41:54.978140 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:41:54.978140 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:41:54.978140 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: 5778103c646049f5944934e775cba9da Jun 27 09:41:54.978140 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-TestMinimumBasicScenario-1543834741-project Jun 27 09:41:54.978140 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: > Jun 27 09:41:54.978140 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Instance b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 is not attached to volume 49428e7d-b2d7-4ffc-bcab-1b92c5c10c0e Jun 27 09:41:54.979021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'server_id': 'b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129', 'id': '49428e7d-b2d7-4ffc-bcab-1b92c5c10c0e'} Jun 27 09:41:54.979021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:41:54.979021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:41:54.979021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 27 09:41:54.979021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 27 09:41:54.979021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 09:41:54.979021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 09:41:54.979021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 27 09:41:54.979021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 27 09:41:54.979021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 49428e7d-b2d7-4ffc-bcab-1b92c5c10c0e. Jun 27 09:41:54.979021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:41:54.979021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:41:54.979021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:41:54.979021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:41:54.979021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:41:54.979021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:41:54.979021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:41:54.979021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:41:54.979021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:41:54.980484 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:41:54.980484 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 27 09:41:54.980484 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 27 09:41:54.980484 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 is not attached to volume 49428e7d-b2d7-4ffc-bcab-1b92c5c10c0e Jun 27 09:41:54.980484 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:41:54.980484 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:41:54.980484 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:41:54.980484 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:41:54.980484 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:41:54.980484 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:41:54.980484 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:41:54.980484 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:41:54.980484 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 is not attached to volume 49428e7d-b2d7-4ffc-bcab-1b92c5c10c0e Jun 27 09:41:54.980484 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:41:54.980484 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-16c7dfb0-316e-4e71-9ab9-5ccf72f87df2 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Returning 404 to user: Instance b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 is not attached to volume 49428e7d-b2d7-4ffc-bcab-1b92c5c10c0e {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:41:54.981550 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-16c7dfb0-316e-4e71-9ab9-5ccf72f87df2 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129/os-volume_attachments/49428e7d-b2d7-4ffc-bcab-1b92c5c10c0e" status: 404 len: 154 microversion: 2.1 time: 0.096178 Jun 27 09:41:54.982094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 369/712] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jun 27 09:41:54 2022] DELETE /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129/os-volume_attachments/49428e7d-b2d7-4ffc-bcab-1b92c5c10c0e => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:41:55.867921 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-85199e33-b896-4c67-af83-51ae4e14407b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:55.868584 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-85199e33-b896-4c67-af83-51ae4e14407b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:55.874987 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-85199e33-b896-4c67-af83-51ae4e14407b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:55.876075 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-85199e33-b896-4c67-af83-51ae4e14407b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:55.876839 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-85199e33-b896-4c67-af83-51ae4e14407b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:55.877270 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-85199e33-b896-4c67-af83-51ae4e14407b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:56.012605 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-85199e33-b896-4c67-af83-51ae4e14407b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:56.020597 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-85199e33-b896-4c67-af83-51ae4e14407b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:56.022108 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-85199e33-b896-4c67-af83-51ae4e14407b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:56.023287 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-85199e33-b896-4c67-af83-51ae4e14407b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1723 microversion: 2.20 time: 0.159172 Jun 27 09:41:56.023885 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 344/713] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:41:55 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:41:56.216279 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-2afedf5e-1bc9-4fb8-8649-a7c7c9f02785 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:56.216868 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-2afedf5e-1bc9-4fb8-8649-a7c7c9f02785 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:56.223519 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2afedf5e-1bc9-4fb8-8649-a7c7c9f02785 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:56.223989 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2afedf5e-1bc9-4fb8-8649-a7c7c9f02785 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:56.224752 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2afedf5e-1bc9-4fb8-8649-a7c7c9f02785 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:56.225204 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2afedf5e-1bc9-4fb8-8649-a7c7c9f02785 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:56.251904 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-2afedf5e-1bc9-4fb8-8649-a7c7c9f02785 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Going to try to terminate instance {{(pid=124869) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 09:41:56.528151 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-2afedf5e-1bc9-4fb8-8649-a7c7c9f02785 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 204 len: 0 microversion: 2.1 time: 0.316161 Jun 27 09:41:56.528658 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 370/714] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:41:56 2022] DELETE /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 09:41:56.536687 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-b51e0e74-993c-4656-8711-1dfbd513c0db tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:56.537342 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-b51e0e74-993c-4656-8711-1dfbd513c0db tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:56.543672 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b51e0e74-993c-4656-8711-1dfbd513c0db tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:56.544128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b51e0e74-993c-4656-8711-1dfbd513c0db tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:56.544896 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b51e0e74-993c-4656-8711-1dfbd513c0db tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:56.545331 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b51e0e74-993c-4656-8711-1dfbd513c0db tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:56.683686 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-b51e0e74-993c-4656-8711-1dfbd513c0db tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:56.691246 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-b51e0e74-993c-4656-8711-1dfbd513c0db tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1553 microversion: 2.1 time: 0.158291 Jun 27 09:41:56.691843 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 345/715] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:56 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:57.043458 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-218ee9c9-1e06-4367-9feb-9504a7d69bd1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:57.044173 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-218ee9c9-1e06-4367-9feb-9504a7d69bd1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:57.050137 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-218ee9c9-1e06-4367-9feb-9504a7d69bd1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:57.050582 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-218ee9c9-1e06-4367-9feb-9504a7d69bd1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:57.053681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-218ee9c9-1e06-4367-9feb-9504a7d69bd1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:57.053681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-218ee9c9-1e06-4367-9feb-9504a7d69bd1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:57.178289 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-218ee9c9-1e06-4367-9feb-9504a7d69bd1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:57.186775 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-218ee9c9-1e06-4367-9feb-9504a7d69bd1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:57.188314 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-218ee9c9-1e06-4367-9feb-9504a7d69bd1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:57.189469 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-218ee9c9-1e06-4367-9feb-9504a7d69bd1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1723 microversion: 2.20 time: 0.151100 Jun 27 09:41:57.190022 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 371/716] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:41:57 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:41:57.709053 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a647728a-9273-4ada-b666-aaf0dc1147c4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:57.709675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-a647728a-9273-4ada-b666-aaf0dc1147c4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:57.716715 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a647728a-9273-4ada-b666-aaf0dc1147c4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:57.717164 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a647728a-9273-4ada-b666-aaf0dc1147c4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:57.717936 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a647728a-9273-4ada-b666-aaf0dc1147c4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:57.718372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a647728a-9273-4ada-b666-aaf0dc1147c4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:57.849582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a647728a-9273-4ada-b666-aaf0dc1147c4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:57.857306 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-a647728a-9273-4ada-b666-aaf0dc1147c4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1553 microversion: 2.1 time: 0.152054 Jun 27 09:41:57.857875 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 346/717] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:57 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:58.207589 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-d858e0eb-fcd8-4f9c-8ac0-f7c66fdd72e7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:58.208242 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-d858e0eb-fcd8-4f9c-8ac0-f7c66fdd72e7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:58.214914 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d858e0eb-fcd8-4f9c-8ac0-f7c66fdd72e7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:58.215311 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d858e0eb-fcd8-4f9c-8ac0-f7c66fdd72e7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:58.216108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d858e0eb-fcd8-4f9c-8ac0-f7c66fdd72e7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:58.216543 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d858e0eb-fcd8-4f9c-8ac0-f7c66fdd72e7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:58.353357 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-d858e0eb-fcd8-4f9c-8ac0-f7c66fdd72e7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:58.361465 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-d858e0eb-fcd8-4f9c-8ac0-f7c66fdd72e7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:58.363274 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-d858e0eb-fcd8-4f9c-8ac0-f7c66fdd72e7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:58.364494 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-d858e0eb-fcd8-4f9c-8ac0-f7c66fdd72e7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1723 microversion: 2.20 time: 0.160775 Jun 27 09:41:58.365057 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 372/718] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:41:58 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:41:58.874817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-6a64dd4c-47b7-4d15-b222-66a38da30497 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:58.876143 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-6a64dd4c-47b7-4d15-b222-66a38da30497 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:58.885860 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6a64dd4c-47b7-4d15-b222-66a38da30497 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:58.886006 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6a64dd4c-47b7-4d15-b222-66a38da30497 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:58.886811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6a64dd4c-47b7-4d15-b222-66a38da30497 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:58.887244 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6a64dd4c-47b7-4d15-b222-66a38da30497 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:58.932409 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-4e776ee9-91cb-4bc4-8854-5596c3e1b71b req-ec93ed28-b4f3-41a1-8524-4575a2a8cd99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129", "name": "network-vif-deleted", "tag": "b7d364ab-ebca-4312-8213-6c5cc722e7bc"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:41:58.940523 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-4e776ee9-91cb-4bc4-8854-5596c3e1b71b req-ec93ed28-b4f3-41a1-8524-4575a2a8cd99 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:58.941041 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-4e776ee9-91cb-4bc4-8854-5596c3e1b71b req-ec93ed28-b4f3-41a1-8524-4575a2a8cd99 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:58.952306 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-4e776ee9-91cb-4bc4-8854-5596c3e1b71b req-ec93ed28-b4f3-41a1-8524-4575a2a8cd99 service nova] Creating event network-vif-deleted:b7d364ab-ebca-4312-8213-6c5cc722e7bc for instance b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 on hv-cinder-84773 Jun 27 09:41:58.957272 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-4e776ee9-91cb-4bc4-8854-5596c3e1b71b req-ec93ed28-b4f3-41a1-8524-4575a2a8cd99 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028642 Jun 27 09:41:58.957895 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 373/719] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:41:58.960588 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-6a64dd4c-47b7-4d15-b222-66a38da30497 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5778103c646049f5944934e775cba9da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f89ed92a124e2c8a274975bc0935ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:58.969314 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-6a64dd4c-47b7-4d15-b222-66a38da30497 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 200 len: 1511 microversion: 2.1 time: 0.098735 Jun 27 09:41:58.969922 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 347/720] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:58 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 1511 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:41:59.383363 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-0c05d30e-dfae-4ccb-86f1-c675ea603ae9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:59.384191 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-0c05d30e-dfae-4ccb-86f1-c675ea603ae9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:59.391165 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0c05d30e-dfae-4ccb-86f1-c675ea603ae9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:59.391635 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0c05d30e-dfae-4ccb-86f1-c675ea603ae9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:59.392388 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0c05d30e-dfae-4ccb-86f1-c675ea603ae9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:59.392826 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0c05d30e-dfae-4ccb-86f1-c675ea603ae9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:59.522047 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-0c05d30e-dfae-4ccb-86f1-c675ea603ae9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:59.530620 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-0c05d30e-dfae-4ccb-86f1-c675ea603ae9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:59.532227 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-0c05d30e-dfae-4ccb-86f1-c675ea603ae9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:41:59.533393 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-0c05d30e-dfae-4ccb-86f1-c675ea603ae9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1723 microversion: 2.20 time: 0.154842 Jun 27 09:41:59.533953 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 374/721] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:41:59 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:41:59.986147 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-952ab91a-fca3-464f-83ab-5074bb84dde4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:41:59.986746 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-952ab91a-fca3-464f-83ab-5074bb84dde4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] [instance: b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:41:59.993258 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-952ab91a-fca3-464f-83ab-5074bb84dde4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:59.993910 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-952ab91a-fca3-464f-83ab-5074bb84dde4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:41:59.994703 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-952ab91a-fca3-464f-83ab-5074bb84dde4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:41:59.995198 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-952ab91a-fca3-464f-83ab-5074bb84dde4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:00.009009 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-952ab91a-fca3-464f-83ab-5074bb84dde4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] HTTP exception thrown: Instance b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 could not be found. Jun 27 09:42:00.011323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-952ab91a-fca3-464f-83ab-5074bb84dde4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Request method failure captured: Jun 27 09:42:00.011323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 HTTP/1.1 Jun 27 09:42:00.011323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:42:00.011323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:42:00.011323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:42:00.011323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:42:00.011323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:42:00.011323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:42:00.011323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:42:00.011323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:42:00.011323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXqmMdRWPq1mKl_d5tHzLLG0XsaZor334N9hd2IakFzCV8gMb0xSTqskIPoAVVpScnRJlzH6cTd7cX68us2qHqpwNG2iIPA3j89KUjk4I-VNksnbQNYV09oEebuUq6GUH1DDKulZkIjuewmylB1MyKhzDMItsXOmQdSsrRj4_8iJTf4 Jun 27 09:42:00.011323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:42:00.011323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:42:00.011323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:42:00.011323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:42:00.011323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:42:00.011323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:42:00.011323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: 55f89ed92a124e2c8a274975bc0935ba Jun 27 09:42:00.011323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-TestMinimumBasicScenario-1543834741 Jun 27 09:42:00.011323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:42:00.011323 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:42:00.012873 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/55f89ed92a124e2c8a274975bc0935ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/55f89ed92a124e2c8a274975bc0935ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/55f89ed92a124e2c8a274975bc0935ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_55f89ed92a124e2c8a274975bc0935ba", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:42:00.012873 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-TestMinimumBasicScenario-1543834741 Jun 27 09:42:00.012873 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: 55f89ed92a124e2c8a274975bc0935ba Jun 27 09:42:00.012873 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1543834741 Jun 27 09:42:00.012873 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-TestMinimumBasicScenario-1543834741-project Jun 27 09:42:00.012873 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:42:00.012873 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:42:00.012873 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: 5778103c646049f5944934e775cba9da Jun 27 09:42:00.012873 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-TestMinimumBasicScenario-1543834741-project Jun 27 09:42:00.012873 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: > Jun 27 09:42:00.012873 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Instance b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 could not be found. Jun 27 09:42:00.012873 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': 'b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129'} Jun 27 09:42:00.014222 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:42:00.014222 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:42:00.014222 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:42:00.014222 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:42:00.014222 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:42:00.014222 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:42:00.014222 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:42:00.014222 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:42:00.014222 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:42:00.014222 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:42:00.014222 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 could not be found. Jun 27 09:42:00.014222 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:42:00.014222 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:42:00.014222 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:42:00.014222 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:42:00.014222 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:42:00.014222 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:42:00.014222 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:42:00.014222 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:42:00.014222 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:42:00.015916 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:42:00.015916 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:42:00.015916 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:42:00.015916 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:42:00.015916 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:42:00.015916 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:42:00.015916 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:42:00.015916 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 could not be found. Jun 27 09:42:00.015916 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:42:00.015916 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:42:00.015916 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:42:00.015916 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:42:00.015916 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:42:00.015916 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:42:00.015916 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:42:00.015916 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:42:00.015916 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 could not be found. Jun 27 09:42:00.015916 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:42:00.018010 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-952ab91a-fca3-464f-83ab-5074bb84dde4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Returning 404 to user: Instance b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:42:00.018010 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-952ab91a-fca3-464f-83ab-5074bb84dde4 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129" status: 404 len: 111 microversion: 2.1 time: 0.030525 Jun 27 09:42:00.018010 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 348/722] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:41:59 2022] GET /compute/v2.1/servers/b6063ae7-7e4d-4a3d-a0ff-71bdd45c6129 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:42:00.021722 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-462ec360-6372-4819-aa8f-cd0d798c46a0 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] Calling method '.version_select at 0x7ffa97395670>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:00.105745 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-462ec360-6372-4819-aa8f-cd0d798c46a0 tempest-TestMinimumBasicScenario-1543834741 tempest-TestMinimumBasicScenario-1543834741-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-442421444" status: 202 len: 0 microversion: 2.1 time: 0.087817 Jun 27 09:42:00.106335 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 375/723] 10.222.0.64 () {58 vars in 1268 bytes} [Mon Jun 27 09:42:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-442421444 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:42:00.552305 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-86a1034c-7bcf-44a2-b86e-63672c0dc0e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:00.552963 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-86a1034c-7bcf-44a2-b86e-63672c0dc0e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:00.559642 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-86a1034c-7bcf-44a2-b86e-63672c0dc0e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:00.560099 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-86a1034c-7bcf-44a2-b86e-63672c0dc0e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:00.560871 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-86a1034c-7bcf-44a2-b86e-63672c0dc0e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:00.561310 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-86a1034c-7bcf-44a2-b86e-63672c0dc0e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:00.690598 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-86a1034c-7bcf-44a2-b86e-63672c0dc0e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:00.699228 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-86a1034c-7bcf-44a2-b86e-63672c0dc0e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:00.700823 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-86a1034c-7bcf-44a2-b86e-63672c0dc0e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:00.701981 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-86a1034c-7bcf-44a2-b86e-63672c0dc0e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1723 microversion: 2.20 time: 0.153596 Jun 27 09:42:00.702553 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 349/724] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:00 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:01.720652 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-9ac8c1d2-7b61-4120-b884-af3df5a6612d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:01.721367 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-9ac8c1d2-7b61-4120-b884-af3df5a6612d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:01.727930 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9ac8c1d2-7b61-4120-b884-af3df5a6612d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:01.728387 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9ac8c1d2-7b61-4120-b884-af3df5a6612d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:01.729157 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9ac8c1d2-7b61-4120-b884-af3df5a6612d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:01.729606 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9ac8c1d2-7b61-4120-b884-af3df5a6612d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:01.860658 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-9ac8c1d2-7b61-4120-b884-af3df5a6612d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:01.868695 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-9ac8c1d2-7b61-4120-b884-af3df5a6612d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:01.870744 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-9ac8c1d2-7b61-4120-b884-af3df5a6612d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:01.871931 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-9ac8c1d2-7b61-4120-b884-af3df5a6612d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1723 microversion: 2.20 time: 0.155268 Jun 27 09:42:01.872586 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 376/725] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:01 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:42:02.890403 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-61646a88-83dd-4391-9fe3-7238d271eecf tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:02.891010 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-61646a88-83dd-4391-9fe3-7238d271eecf tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:02.897582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-61646a88-83dd-4391-9fe3-7238d271eecf tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:02.898030 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-61646a88-83dd-4391-9fe3-7238d271eecf tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:02.898790 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-61646a88-83dd-4391-9fe3-7238d271eecf tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:02.899220 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-61646a88-83dd-4391-9fe3-7238d271eecf tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:03.101214 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-61646a88-83dd-4391-9fe3-7238d271eecf tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:03.109204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-61646a88-83dd-4391-9fe3-7238d271eecf tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:03.110710 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-61646a88-83dd-4391-9fe3-7238d271eecf tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:03.111904 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-61646a88-83dd-4391-9fe3-7238d271eecf tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1723 microversion: 2.20 time: 0.225359 Jun 27 09:42:03.112465 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 350/726] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:02 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:04.130889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-78dd25a6-394b-4744-a7b8-ac700ff42513 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:04.131498 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-78dd25a6-394b-4744-a7b8-ac700ff42513 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:04.134046 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:04.139335 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-78dd25a6-394b-4744-a7b8-ac700ff42513 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:04.139829 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-78dd25a6-394b-4744-a7b8-ac700ff42513 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:04.140590 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-78dd25a6-394b-4744-a7b8-ac700ff42513 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:04.141024 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-78dd25a6-394b-4744-a7b8-ac700ff42513 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:04.211396 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c3bbb420-32d8-4076-9c49-32bb5513ea4f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:04.212726 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-c3bbb420-32d8-4076-9c49-32bb5513ea4f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:04.219293 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c3bbb420-32d8-4076-9c49-32bb5513ea4f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:04.222421 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c3bbb420-32d8-4076-9c49-32bb5513ea4f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:04.223263 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c3bbb420-32d8-4076-9c49-32bb5513ea4f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:04.223746 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c3bbb420-32d8-4076-9c49-32bb5513ea4f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:04.258530 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-c3bbb420-32d8-4076-9c49-32bb5513ea4f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380/ips" status: 200 len: 150 microversion: 2.1 time: 0.050952 Jun 27 09:42:04.259375 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 351/727] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jun 27 09:42:04 2022] GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380/ips => generated 150 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:42:04.310732 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-78dd25a6-394b-4744-a7b8-ac700ff42513 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:04.320315 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-78dd25a6-394b-4744-a7b8-ac700ff42513 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:04.322421 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-78dd25a6-394b-4744-a7b8-ac700ff42513 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:04.324644 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-78dd25a6-394b-4744-a7b8-ac700ff42513 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1723 microversion: 2.20 time: 0.197980 Jun 27 09:42:04.325750 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 377/728] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:04 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:05.344495 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-5d61e56e-1ede-4bd8-b441-5fc8fa5b81d5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:05.345393 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-5d61e56e-1ede-4bd8-b441-5fc8fa5b81d5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:05.348620 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:05.353842 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5d61e56e-1ede-4bd8-b441-5fc8fa5b81d5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:05.355273 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5d61e56e-1ede-4bd8-b441-5fc8fa5b81d5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:05.356236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5d61e56e-1ede-4bd8-b441-5fc8fa5b81d5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:05.356778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5d61e56e-1ede-4bd8-b441-5fc8fa5b81d5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:05.573928 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-5d61e56e-1ede-4bd8-b441-5fc8fa5b81d5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:05.582868 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-5d61e56e-1ede-4bd8-b441-5fc8fa5b81d5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:05.584408 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-5d61e56e-1ede-4bd8-b441-5fc8fa5b81d5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:05.585609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-5d61e56e-1ede-4bd8-b441-5fc8fa5b81d5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1723 microversion: 2.20 time: 0.246084 Jun 27 09:42:05.586172 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 352/729] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:05 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:42:05.897526 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-06858ace-826e-4943-9f95-6991fe040926 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "132c1f3f-3f43-452b-9aed-c3a8b7a1e101"}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:42:05.898572 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-06858ace-826e-4943-9f95-6991fe040926 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:05.905906 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-06858ace-826e-4943-9f95-6991fe040926 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:05.906354 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-06858ace-826e-4943-9f95-6991fe040926 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:05.907155 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-06858ace-826e-4943-9f95-6991fe040926 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:05.907671 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-06858ace-826e-4943-9f95-6991fe040926 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:06.604502 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-372c2e05-c42b-42ff-8a7f-e33eb66f55bd tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:06.605974 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-372c2e05-c42b-42ff-8a7f-e33eb66f55bd tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:06.612624 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-372c2e05-c42b-42ff-8a7f-e33eb66f55bd tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:06.613080 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-372c2e05-c42b-42ff-8a7f-e33eb66f55bd tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:06.613854 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-372c2e05-c42b-42ff-8a7f-e33eb66f55bd tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:06.614295 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-372c2e05-c42b-42ff-8a7f-e33eb66f55bd tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:06.749129 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-372c2e05-c42b-42ff-8a7f-e33eb66f55bd tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:06.757317 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-372c2e05-c42b-42ff-8a7f-e33eb66f55bd tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:06.758834 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-372c2e05-c42b-42ff-8a7f-e33eb66f55bd tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:06.760204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-372c2e05-c42b-42ff-8a7f-e33eb66f55bd tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1723 microversion: 2.20 time: 0.159759 Jun 27 09:42:06.761284 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 353/730] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:06 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:42:06.776692 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-06858ace-826e-4943-9f95-6991fe040926 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "POST /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.873593 Jun 27 09:42:06.776692 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 378/731] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 27 09:42:05 2022] POST /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380/os-volume_attachments => generated 194 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:42:07.780931 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-7f50e243-fb52-49de-af94-9a9bf8d7340b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:07.781752 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-7f50e243-fb52-49de-af94-9a9bf8d7340b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:07.788653 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7f50e243-fb52-49de-af94-9a9bf8d7340b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:07.789166 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7f50e243-fb52-49de-af94-9a9bf8d7340b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:07.790060 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7f50e243-fb52-49de-af94-9a9bf8d7340b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:07.790603 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7f50e243-fb52-49de-af94-9a9bf8d7340b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:08.005219 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-7f50e243-fb52-49de-af94-9a9bf8d7340b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:08.015691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-7f50e243-fb52-49de-af94-9a9bf8d7340b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:08.017176 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-7f50e243-fb52-49de-af94-9a9bf8d7340b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:08.018348 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-7f50e243-fb52-49de-af94-9a9bf8d7340b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1744 microversion: 2.20 time: 0.242052 Jun 27 09:42:08.018903 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 354/732] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:07 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1744 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:09.037959 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-c39ce443-8314-439e-b897-69f09eedbd3d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:09.038627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-c39ce443-8314-439e-b897-69f09eedbd3d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:09.048237 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c39ce443-8314-439e-b897-69f09eedbd3d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:09.049998 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c39ce443-8314-439e-b897-69f09eedbd3d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:09.051762 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c39ce443-8314-439e-b897-69f09eedbd3d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:09.052434 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c39ce443-8314-439e-b897-69f09eedbd3d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:09.236344 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-c39ce443-8314-439e-b897-69f09eedbd3d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:09.248993 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-c39ce443-8314-439e-b897-69f09eedbd3d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:09.250492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-c39ce443-8314-439e-b897-69f09eedbd3d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:09.252837 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-c39ce443-8314-439e-b897-69f09eedbd3d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1739 microversion: 2.20 time: 0.219037 Jun 27 09:42:09.262881 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 379/733] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:09 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:10.277300 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-4199d27e-d0aa-4003-911b-d6a2561de3b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:10.278151 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-4199d27e-d0aa-4003-911b-d6a2561de3b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:10.285685 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4199d27e-d0aa-4003-911b-d6a2561de3b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:10.287119 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4199d27e-d0aa-4003-911b-d6a2561de3b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:10.289752 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4199d27e-d0aa-4003-911b-d6a2561de3b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:10.290858 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4199d27e-d0aa-4003-911b-d6a2561de3b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:10.473815 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4199d27e-d0aa-4003-911b-d6a2561de3b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:10.483631 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4199d27e-d0aa-4003-911b-d6a2561de3b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:10.486000 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4199d27e-d0aa-4003-911b-d6a2561de3b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:10.487573 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-4199d27e-d0aa-4003-911b-d6a2561de3b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1739 microversion: 2.20 time: 0.218642 Jun 27 09:42:10.488319 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 355/734] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:10 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:11.310112 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-5ecc1164-b196-4cca-9d50-e0268c1a5f5a req-b078e923-1e72-4a02-a57a-ae61ca784037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "448074d1-f23d-4254-a9ec-26b00bd1298c", "name": "network-vif-plugged", "status": "completed", "tag": "55e62be6-d365-40b9-9f9d-24357beba5b2"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:42:11.320285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-5ecc1164-b196-4cca-9d50-e0268c1a5f5a req-b078e923-1e72-4a02-a57a-ae61ca784037 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:11.320285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-5ecc1164-b196-4cca-9d50-e0268c1a5f5a req-b078e923-1e72-4a02-a57a-ae61ca784037 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:11.333092 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-5ecc1164-b196-4cca-9d50-e0268c1a5f5a req-b078e923-1e72-4a02-a57a-ae61ca784037 service nova] Creating event network-vif-plugged:55e62be6-d365-40b9-9f9d-24357beba5b2 for instance 448074d1-f23d-4254-a9ec-26b00bd1298c on hv-cinder-84773 Jun 27 09:42:11.338656 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-5ecc1164-b196-4cca-9d50-e0268c1a5f5a req-b078e923-1e72-4a02-a57a-ae61ca784037 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.251997 Jun 27 09:42:11.339893 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 380/735] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:42:11.506194 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-42df62d2-6431-4610-ae8f-23891237888a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:11.507370 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-42df62d2-6431-4610-ae8f-23891237888a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:11.518824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-42df62d2-6431-4610-ae8f-23891237888a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:11.519501 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-42df62d2-6431-4610-ae8f-23891237888a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:11.520533 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-42df62d2-6431-4610-ae8f-23891237888a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:11.521116 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-42df62d2-6431-4610-ae8f-23891237888a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:11.722670 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-42df62d2-6431-4610-ae8f-23891237888a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:11.743553 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-42df62d2-6431-4610-ae8f-23891237888a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:11.751778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-42df62d2-6431-4610-ae8f-23891237888a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:11.752951 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-42df62d2-6431-4610-ae8f-23891237888a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1739 microversion: 2.20 time: 0.250822 Jun 27 09:42:11.767617 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 356/736] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:11 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1739 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:12.776525 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-27b9ecc3-3d95-42ef-8b8e-c0284b4be150 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:12.777288 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-27b9ecc3-3d95-42ef-8b8e-c0284b4be150 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:12.784474 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-27b9ecc3-3d95-42ef-8b8e-c0284b4be150 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:12.785202 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-27b9ecc3-3d95-42ef-8b8e-c0284b4be150 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:12.786044 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-27b9ecc3-3d95-42ef-8b8e-c0284b4be150 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:12.786491 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-27b9ecc3-3d95-42ef-8b8e-c0284b4be150 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:12.950177 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-27b9ecc3-3d95-42ef-8b8e-c0284b4be150 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:12.958813 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-27b9ecc3-3d95-42ef-8b8e-c0284b4be150 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:12.960447 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-27b9ecc3-3d95-42ef-8b8e-c0284b4be150 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:12.961659 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-27b9ecc3-3d95-42ef-8b8e-c0284b4be150 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1739 microversion: 2.20 time: 0.189826 Jun 27 09:42:12.962234 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 381/737] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:12 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:13.989797 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-87ab285e-35dd-406d-8e85-ab1cd3b4560e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:13.989797 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-87ab285e-35dd-406d-8e85-ab1cd3b4560e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:13.991169 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-87ab285e-35dd-406d-8e85-ab1cd3b4560e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:13.992063 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-87ab285e-35dd-406d-8e85-ab1cd3b4560e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:13.993166 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-87ab285e-35dd-406d-8e85-ab1cd3b4560e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:13.993832 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-87ab285e-35dd-406d-8e85-ab1cd3b4560e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:14.157381 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-87ab285e-35dd-406d-8e85-ab1cd3b4560e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:14.168203 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-87ab285e-35dd-406d-8e85-ab1cd3b4560e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:14.169952 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-87ab285e-35dd-406d-8e85-ab1cd3b4560e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:14.171300 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-87ab285e-35dd-406d-8e85-ab1cd3b4560e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1739 microversion: 2.20 time: 0.194456 Jun 27 09:42:14.172406 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 357/738] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:13 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:14.441133 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-fae458ad-3b92-4774-b154-0ca7af69d480 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "132c1f3f-3f43-452b-9aed-c3a8b7a1e101"}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:42:14.442185 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-fae458ad-3b92-4774-b154-0ca7af69d480 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:14.449299 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fae458ad-3b92-4774-b154-0ca7af69d480 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:14.449747 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fae458ad-3b92-4774-b154-0ca7af69d480 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:14.450521 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fae458ad-3b92-4774-b154-0ca7af69d480 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:14.450960 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fae458ad-3b92-4774-b154-0ca7af69d480 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:14.459285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:14.549272 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-fae458ad-3b92-4774-b154-0ca7af69d480 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] HTTP exception thrown: Invalid volume: volume 132c1f3f-3f43-452b-9aed-c3a8b7a1e101 is already attached to instances: 70f57aa8-bd53-4836-97d8-44a90cfb3380 Jun 27 09:42:14.551297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-fae458ad-3b92-4774-b154-0ca7af69d480 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Request method failure captured: Jun 27 09:42:14.551297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: POST /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380/os-volume_attachments HTTP/1.1 Jun 27 09:42:14.551297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:42:14.551297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:42:14.551297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:42:14.551297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 74 Jun 27 09:42:14.551297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:42:14.551297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:42:14.551297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:42:14.551297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:42:14.551297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXpn-3iJO0jmG6cEr_seNLdcseHi8n8wEHckwmRo6ljOk7Dw2fW8MzVJsAVvtrRo6EbRwOL-ZWvD5H6s-lM4yKMyphFO-R0p3TN9KgYR5zUQQ4U5gMxDEUMuzuQRv_UTCVszqW1Rzxb7_cNEjM991nroZ5_Kz-paBsAlLj4MpU5gWgY Jun 27 09:42:14.551297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:42:14.551297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:42:14.551297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:42:14.551297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:42:14.551297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:42:14.551297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:42:14.551297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:42:14.551297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:42:14.551297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:42:14.551297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:42:14.553124 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4b698ead017b4ef8b397ee127b487309", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:42:14.553124 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:42:14.553124 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:42:14.553124 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:42:14.553124 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:42:14.553124 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:42:14.553124 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:42:14.553124 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: cc8a087e97424d2890952be33695378f Jun 27 09:42:14.553124 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:42:14.553124 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Jun 27 09:42:14.553124 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {"volumeAttachment": {"volumeId": "132c1f3f-3f43-452b-9aed-c3a8b7a1e101"}} Jun 27 09:42:14.553124 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: > Jun 27 09:42:14.554362 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Invalid volume: volume 132c1f3f-3f43-452b-9aed-c3a8b7a1e101 is already attached to instances: 70f57aa8-bd53-4836-97d8-44a90cfb3380 Jun 27 09:42:14.554362 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'server_id': '70f57aa8-bd53-4836-97d8-44a90cfb3380', 'body': {'volumeAttachment': {'volumeId': '132c1f3f-3f43-452b-9aed-c3a8b7a1e101'}}} Jun 27 09:42:14.554362 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:42:14.554362 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:42:14.554362 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 27 09:42:14.554362 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 27 09:42:14.554362 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 09:42:14.554362 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 09:42:14.554362 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 27 09:42:14.554362 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 27 09:42:14.554362 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 27 09:42:14.554362 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 27 09:42:14.554362 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 27 09:42:14.554362 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 27 09:42:14.554362 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 132c1f3f-3f43-452b-9aed-c3a8b7a1e101 is already attached to instances: 70f57aa8-bd53-4836-97d8-44a90cfb3380 Jun 27 09:42:14.554362 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:42:14.554362 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:42:14.554362 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:42:14.554362 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:42:14.555613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:42:14.555613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:42:14.555613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:42:14.555613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:42:14.555613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:42:14.555613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:42:14.555613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 09:42:14.555613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 09:42:14.555613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 09:42:14.555613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 09:42:14.555613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 09:42:14.555613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 09:42:14.555613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 27 09:42:14.555613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 27 09:42:14.555613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 132c1f3f-3f43-452b-9aed-c3a8b7a1e101 is already attached to instances: 70f57aa8-bd53-4836-97d8-44a90cfb3380 Jun 27 09:42:14.555613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:42:14.555613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:42:14.555613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:42:14.555613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:42:14.555613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:42:14.557669 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:42:14.557669 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:42:14.557669 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:42:14.557669 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 132c1f3f-3f43-452b-9aed-c3a8b7a1e101 is already attached to instances: 70f57aa8-bd53-4836-97d8-44a90cfb3380 Jun 27 09:42:14.557669 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:42:14.557669 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-fae458ad-3b92-4774-b154-0ca7af69d480 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Returning 400 to user: Invalid volume: volume 132c1f3f-3f43-452b-9aed-c3a8b7a1e101 is already attached to instances: 70f57aa8-bd53-4836-97d8-44a90cfb3380 {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:42:14.557669 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-fae458ad-3b92-4774-b154-0ca7af69d480 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "POST /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.115613 Jun 27 09:42:14.557669 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 382/739] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 27 09:42:14 2022] POST /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380/os-volume_attachments => generated 174 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 27 09:42:14.628444 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-169ed838-4bdd-4974-970b-54f8afeb2964 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:14.632462 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-169ed838-4bdd-4974-970b-54f8afeb2964 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:14.637090 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-169ed838-4bdd-4974-970b-54f8afeb2964 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:14.637780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-169ed838-4bdd-4974-970b-54f8afeb2964 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:14.638897 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-169ed838-4bdd-4974-970b-54f8afeb2964 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:14.639615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-169ed838-4bdd-4974-970b-54f8afeb2964 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:14.656220 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=100 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:14.729848 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.objects.instance [None req-169ed838-4bdd-4974-970b-54f8afeb2964 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lazy-loading 'services' on Instance uuid 70f57aa8-bd53-4836-97d8-44a90cfb3380 {{(pid=124870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:42:14.938752 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-169ed838-4bdd-4974-970b-54f8afeb2964 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "DELETE /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380/os-volume_attachments/132c1f3f-3f43-452b-9aed-c3a8b7a1e101" status: 202 len: 0 microversion: 2.1 time: 0.317472 Jun 27 09:42:14.942865 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 358/740] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jun 27 09:42:14 2022] DELETE /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380/os-volume_attachments/132c1f3f-3f43-452b-9aed-c3a8b7a1e101 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:42:14.956137 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-575190e4-944e-4089-bc64-5753e48861fa tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:14.957476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-575190e4-944e-4089-bc64-5753e48861fa tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:14.971823 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-575190e4-944e-4089-bc64-5753e48861fa tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:14.972407 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-575190e4-944e-4089-bc64-5753e48861fa tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:14.973260 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-575190e4-944e-4089-bc64-5753e48861fa tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:14.973768 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-575190e4-944e-4089-bc64-5753e48861fa tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:15.004976 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-575190e4-944e-4089-bc64-5753e48861fa tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060733 Jun 27 09:42:15.006289 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 383/741] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 27 09:42:14 2022] GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:42:15.191737 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-0adf82d8-db56-412e-b747-4e175b4d2dc7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:15.193035 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-0adf82d8-db56-412e-b747-4e175b4d2dc7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:15.200536 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0adf82d8-db56-412e-b747-4e175b4d2dc7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:15.201234 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0adf82d8-db56-412e-b747-4e175b4d2dc7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:15.202339 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0adf82d8-db56-412e-b747-4e175b4d2dc7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:15.203036 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0adf82d8-db56-412e-b747-4e175b4d2dc7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:15.375778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-0adf82d8-db56-412e-b747-4e175b4d2dc7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:15.384776 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-0adf82d8-db56-412e-b747-4e175b4d2dc7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:15.386509 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-0adf82d8-db56-412e-b747-4e175b4d2dc7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:15.388062 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-0adf82d8-db56-412e-b747-4e175b4d2dc7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1739 microversion: 2.20 time: 0.201514 Jun 27 09:42:15.389125 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 359/742] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:15 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:16.017469 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-57b16ad5-b1be-42c1-99c5-628a1b9bcf12 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:16.018458 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-57b16ad5-b1be-42c1-99c5-628a1b9bcf12 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:16.026035 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-57b16ad5-b1be-42c1-99c5-628a1b9bcf12 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:16.030921 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-57b16ad5-b1be-42c1-99c5-628a1b9bcf12 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:16.030921 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-57b16ad5-b1be-42c1-99c5-628a1b9bcf12 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:16.030921 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-57b16ad5-b1be-42c1-99c5-628a1b9bcf12 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:16.059983 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-57b16ad5-b1be-42c1-99c5-628a1b9bcf12 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046856 Jun 27 09:42:16.060846 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 384/743] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 27 09:42:16 2022] GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:42:16.406644 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c7df07f1-3c84-4a04-8490-9d87340728b2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:16.407248 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-c7df07f1-3c84-4a04-8490-9d87340728b2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:16.413868 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c7df07f1-3c84-4a04-8490-9d87340728b2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:16.414315 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c7df07f1-3c84-4a04-8490-9d87340728b2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:16.415079 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c7df07f1-3c84-4a04-8490-9d87340728b2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:16.415518 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c7df07f1-3c84-4a04-8490-9d87340728b2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:16.548026 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-c7df07f1-3c84-4a04-8490-9d87340728b2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:16.556299 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-c7df07f1-3c84-4a04-8490-9d87340728b2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:16.558373 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-c7df07f1-3c84-4a04-8490-9d87340728b2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:16.559586 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-c7df07f1-3c84-4a04-8490-9d87340728b2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1739 microversion: 2.20 time: 0.156782 Jun 27 09:42:16.560152 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 360/744] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:16 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:17.072521 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-ae90838e-22c3-4374-a5b1-df8d62caf87c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:17.074597 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-ae90838e-22c3-4374-a5b1-df8d62caf87c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:17.081517 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ae90838e-22c3-4374-a5b1-df8d62caf87c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:17.082233 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ae90838e-22c3-4374-a5b1-df8d62caf87c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:17.083083 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ae90838e-22c3-4374-a5b1-df8d62caf87c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:17.083619 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ae90838e-22c3-4374-a5b1-df8d62caf87c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:17.121378 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-ae90838e-22c3-4374-a5b1-df8d62caf87c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052853 Jun 27 09:42:17.127110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 385/745] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 27 09:42:17 2022] GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 09:42:17.183290 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-fa7aee0e-e820-492b-badf-f3a8a55f48a4 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:17.194355 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-fa7aee0e-e820-492b-badf-f3a8a55f48a4 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:17.194355 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fa7aee0e-e820-492b-badf-f3a8a55f48a4 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:17.194355 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fa7aee0e-e820-492b-badf-f3a8a55f48a4 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:17.194355 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fa7aee0e-e820-492b-badf-f3a8a55f48a4 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:17.194779 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fa7aee0e-e820-492b-badf-f3a8a55f48a4 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:17.218468 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-fa7aee0e-e820-492b-badf-f3a8a55f48a4 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Going to try to terminate instance {{(pid=124870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 09:42:17.578618 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-3070f8c0-1b73-4bc4-b0f4-a969e3e5b2e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:17.579411 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-3070f8c0-1b73-4bc4-b0f4-a969e3e5b2e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:17.585070 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-fa7aee0e-e820-492b-badf-f3a8a55f48a4 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "DELETE /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380" status: 204 len: 0 microversion: 2.1 time: 0.406025 Jun 27 09:42:17.588634 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 361/746] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:42:17 2022] DELETE /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 09:42:17.594822 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3070f8c0-1b73-4bc4-b0f4-a969e3e5b2e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:17.599557 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-909295ed-9248-46cf-b282-32cb0cc0c89b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:17.600400 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-909295ed-9248-46cf-b282-32cb0cc0c89b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:17.603514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3070f8c0-1b73-4bc4-b0f4-a969e3e5b2e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:17.606145 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3070f8c0-1b73-4bc4-b0f4-a969e3e5b2e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:17.606704 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3070f8c0-1b73-4bc4-b0f4-a969e3e5b2e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:17.615021 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-909295ed-9248-46cf-b282-32cb0cc0c89b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:17.615848 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-909295ed-9248-46cf-b282-32cb0cc0c89b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:17.616802 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-909295ed-9248-46cf-b282-32cb0cc0c89b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:17.617096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-909295ed-9248-46cf-b282-32cb0cc0c89b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:17.787977 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-3070f8c0-1b73-4bc4-b0f4-a969e3e5b2e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:17.797128 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-3070f8c0-1b73-4bc4-b0f4-a969e3e5b2e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:17.799395 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-3070f8c0-1b73-4bc4-b0f4-a969e3e5b2e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:17.801049 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-3070f8c0-1b73-4bc4-b0f4-a969e3e5b2e2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1739 microversion: 2.20 time: 0.226631 Jun 27 09:42:17.812535 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-909295ed-9248-46cf-b282-32cb0cc0c89b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:17.813729 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 386/747] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:17 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1739 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:42:17.818824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-909295ed-9248-46cf-b282-32cb0cc0c89b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380" status: 200 len: 1680 microversion: 2.1 time: 0.224215 Jun 27 09:42:17.819576 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 362/748] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:17 2022] GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380 => generated 1680 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:42:18.820237 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-c8130b7b-ef5f-4d4b-8bd4-c033a3067a13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:18.820844 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-c8130b7b-ef5f-4d4b-8bd4-c033a3067a13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:18.830289 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c8130b7b-ef5f-4d4b-8bd4-c033a3067a13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:18.830742 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c8130b7b-ef5f-4d4b-8bd4-c033a3067a13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:18.831515 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c8130b7b-ef5f-4d4b-8bd4-c033a3067a13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:18.832246 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c8130b7b-ef5f-4d4b-8bd4-c033a3067a13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:18.840780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-3f392ffe-5383-42c8-9b6c-6562e439e042 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:18.842110 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-3f392ffe-5383-42c8-9b6c-6562e439e042 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:18.849280 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3f392ffe-5383-42c8-9b6c-6562e439e042 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:18.850461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3f392ffe-5383-42c8-9b6c-6562e439e042 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:18.851084 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3f392ffe-5383-42c8-9b6c-6562e439e042 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:18.851737 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3f392ffe-5383-42c8-9b6c-6562e439e042 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:18.984260 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-c8130b7b-ef5f-4d4b-8bd4-c033a3067a13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:18.992652 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-c8130b7b-ef5f-4d4b-8bd4-c033a3067a13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:18.993214 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-3f392ffe-5383-42c8-9b6c-6562e439e042 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:18.998299 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-c8130b7b-ef5f-4d4b-8bd4-c033a3067a13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:18.999959 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-c8130b7b-ef5f-4d4b-8bd4-c033a3067a13 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1739 microversion: 2.20 time: 0.183399 Jun 27 09:42:19.001259 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 387/749] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:18 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:19.002672 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-3f392ffe-5383-42c8-9b6c-6562e439e042 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380" status: 200 len: 1680 microversion: 2.1 time: 0.165922 Jun 27 09:42:19.007734 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 363/750] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:18 2022] GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:42:20.021441 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-d303c637-c013-4256-b933-a9e4d6812e7d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:20.022854 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-d303c637-c013-4256-b933-a9e4d6812e7d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:20.031522 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-7ba2ef5c-76d0-4fc0-a28a-5e09af00b663 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:20.031522 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-7ba2ef5c-76d0-4fc0-a28a-5e09af00b663 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:20.035298 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d303c637-c013-4256-b933-a9e4d6812e7d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:20.040347 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d303c637-c013-4256-b933-a9e4d6812e7d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:20.041470 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7ba2ef5c-76d0-4fc0-a28a-5e09af00b663 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:20.041907 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7ba2ef5c-76d0-4fc0-a28a-5e09af00b663 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:20.043189 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d303c637-c013-4256-b933-a9e4d6812e7d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:20.043707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7ba2ef5c-76d0-4fc0-a28a-5e09af00b663 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:20.043983 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d303c637-c013-4256-b933-a9e4d6812e7d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:20.044128 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7ba2ef5c-76d0-4fc0-a28a-5e09af00b663 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:20.123408 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-7ba2ef5c-76d0-4fc0-a28a-5e09af00b663 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:20.131601 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-7ba2ef5c-76d0-4fc0-a28a-5e09af00b663 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380" status: 200 len: 1613 microversion: 2.1 time: 0.115930 Jun 27 09:42:20.132345 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 388/751] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:20 2022] GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380 => generated 1613 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:20.348678 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d303c637-c013-4256-b933-a9e4d6812e7d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:20.357114 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d303c637-c013-4256-b933-a9e4d6812e7d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:20.361441 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d303c637-c013-4256-b933-a9e4d6812e7d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:20.362722 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-d303c637-c013-4256-b933-a9e4d6812e7d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1739 microversion: 2.20 time: 0.346167 Jun 27 09:42:20.363372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 364/752] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:20 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1739 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:42:20.509201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-cc8af6ea-2569-4da0-b362-eb56c19c0c97 req-b7b74316-9d02-4977-98d7-e0d18756f351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f57aa8-bd53-4836-97d8-44a90cfb3380", "name": "network-vif-deleted", "tag": "a2d19843-8e0c-4622-9baa-515a05143fb7"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:42:20.524569 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-cc8af6ea-2569-4da0-b362-eb56c19c0c97 req-b7b74316-9d02-4977-98d7-e0d18756f351 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:20.525624 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-cc8af6ea-2569-4da0-b362-eb56c19c0c97 req-b7b74316-9d02-4977-98d7-e0d18756f351 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:20.537829 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-cc8af6ea-2569-4da0-b362-eb56c19c0c97 req-b7b74316-9d02-4977-98d7-e0d18756f351 service nova] Creating event network-vif-deleted:a2d19843-8e0c-4622-9baa-515a05143fb7 for instance 70f57aa8-bd53-4836-97d8-44a90cfb3380 on hv-cinder-84773 Jun 27 09:42:20.543586 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-cc8af6ea-2569-4da0-b362-eb56c19c0c97 req-b7b74316-9d02-4977-98d7-e0d18756f351 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038402 Jun 27 09:42:20.547340 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 389/753] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:42:21.155306 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-9b5197c3-28a6-4b61-8b88-ac916f4d616a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:21.155306 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-9b5197c3-28a6-4b61-8b88-ac916f4d616a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:21.159140 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9b5197c3-28a6-4b61-8b88-ac916f4d616a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:21.159625 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9b5197c3-28a6-4b61-8b88-ac916f4d616a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:21.160437 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9b5197c3-28a6-4b61-8b88-ac916f4d616a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:21.160876 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9b5197c3-28a6-4b61-8b88-ac916f4d616a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:21.195367 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9b5197c3-28a6-4b61-8b88-ac916f4d616a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:21.195367 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9b5197c3-28a6-4b61-8b88-ac916f4d616a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:21.195567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.objects.instance [None req-9b5197c3-28a6-4b61-8b88-ac916f4d616a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lazy-loading 'fault' on Instance uuid 70f57aa8-bd53-4836-97d8-44a90cfb3380 {{(pid=124870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:42:21.239133 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-9b5197c3-28a6-4b61-8b88-ac916f4d616a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:21.246700 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-9b5197c3-28a6-4b61-8b88-ac916f4d616a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380" status: 200 len: 1330 microversion: 2.1 time: 0.101362 Jun 27 09:42:21.249473 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 365/754] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:21 2022] GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380 => generated 1330 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:21.381969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-3f9f5bde-6b54-4497-9c76-d5e5f1f40b5b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:21.382666 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-3f9f5bde-6b54-4497-9c76-d5e5f1f40b5b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:21.389605 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3f9f5bde-6b54-4497-9c76-d5e5f1f40b5b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:21.390049 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3f9f5bde-6b54-4497-9c76-d5e5f1f40b5b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:21.391000 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3f9f5bde-6b54-4497-9c76-d5e5f1f40b5b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:21.391435 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3f9f5bde-6b54-4497-9c76-d5e5f1f40b5b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:21.536586 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-3f9f5bde-6b54-4497-9c76-d5e5f1f40b5b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:21.543825 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-3f9f5bde-6b54-4497-9c76-d5e5f1f40b5b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:21.545701 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-3f9f5bde-6b54-4497-9c76-d5e5f1f40b5b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:21.546906 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-3f9f5bde-6b54-4497-9c76-d5e5f1f40b5b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1721 microversion: 2.20 time: 0.169751 Jun 27 09:42:21.547490 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 390/755] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:21 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:22.263244 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-799f1349-4e84-4534-acd4-a891ee2f97a2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:22.263909 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-799f1349-4e84-4534-acd4-a891ee2f97a2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:22.270426 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-799f1349-4e84-4534-acd4-a891ee2f97a2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:22.270876 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-799f1349-4e84-4534-acd4-a891ee2f97a2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:22.271686 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-799f1349-4e84-4534-acd4-a891ee2f97a2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:22.275710 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-799f1349-4e84-4534-acd4-a891ee2f97a2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:22.286000 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-799f1349-4e84-4534-acd4-a891ee2f97a2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] HTTP exception thrown: Instance 70f57aa8-bd53-4836-97d8-44a90cfb3380 could not be found. Jun 27 09:42:22.287727 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-799f1349-4e84-4534-acd4-a891ee2f97a2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Request method failure captured: Jun 27 09:42:22.287727 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380 HTTP/1.1 Jun 27 09:42:22.287727 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:42:22.287727 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:42:22.287727 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:42:22.287727 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:42:22.287727 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:42:22.287727 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:42:22.287727 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:42:22.287727 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:42:22.287727 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXpn-3iJO0jmG6cEr_seNLdcseHi8n8wEHckwmRo6ljOk7Dw2fW8MzVJsAVvtrRo6EbRwOL-ZWvD5H6s-lM4yKMyphFO-R0p3TN9KgYR5zUQQ4U5gMxDEUMuzuQRv_UTCVszqW1Rzxb7_cNEjM991nroZ5_Kz-paBsAlLj4MpU5gWgY Jun 27 09:42:22.287727 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:42:22.287727 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:42:22.287727 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:42:22.287727 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:42:22.287727 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:42:22.287727 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:42:22.287727 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:42:22.287727 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:42:22.287727 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:42:22.287727 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:42:22.289168 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4b698ead017b4ef8b397ee127b487309", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:42:22.289168 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:42:22.289168 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:42:22.289168 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:42:22.289168 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:42:22.289168 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:42:22.289168 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:42:22.289168 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: cc8a087e97424d2890952be33695378f Jun 27 09:42:22.289168 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:42:22.289168 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: > Jun 27 09:42:22.289168 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Instance 70f57aa8-bd53-4836-97d8-44a90cfb3380 could not be found. Jun 27 09:42:22.289168 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': '70f57aa8-bd53-4836-97d8-44a90cfb3380'} Jun 27 09:42:22.290563 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:42:22.290563 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:42:22.290563 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:42:22.290563 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:42:22.290563 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:42:22.290563 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:42:22.290563 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:42:22.290563 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:42:22.290563 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:42:22.290563 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:42:22.290563 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70f57aa8-bd53-4836-97d8-44a90cfb3380 could not be found. Jun 27 09:42:22.290563 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:42:22.290563 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:42:22.290563 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:42:22.290563 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:42:22.290563 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:42:22.290563 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:42:22.290563 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:42:22.290563 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:42:22.290563 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:42:22.293039 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:42:22.293039 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:42:22.293039 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:42:22.293039 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:42:22.293039 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:42:22.293039 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:42:22.293039 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:42:22.293039 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70f57aa8-bd53-4836-97d8-44a90cfb3380 could not be found. Jun 27 09:42:22.293039 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:42:22.293039 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:42:22.293039 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:42:22.293039 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:42:22.293039 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:42:22.293039 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:42:22.293039 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:42:22.293039 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:42:22.293039 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70f57aa8-bd53-4836-97d8-44a90cfb3380 could not be found. Jun 27 09:42:22.293039 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:42:22.294447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-799f1349-4e84-4534-acd4-a891ee2f97a2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Returning 404 to user: Instance 70f57aa8-bd53-4836-97d8-44a90cfb3380 could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:42:22.294447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-799f1349-4e84-4534-acd4-a891ee2f97a2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380" status: 404 len: 111 microversion: 2.1 time: 0.029692 Jun 27 09:42:22.294447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 366/756] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:22 2022] GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:42:22.299992 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-cf655d22-a2da-4e36-ad9b-a7dc642e85c4 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '.version_select at 0x7ffa973f2ca0>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:22.403039 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-cf655d22-a2da-4e36-ad9b-a7dc642e85c4 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-189199838" status: 202 len: 0 microversion: 2.1 time: 0.107118 Jun 27 09:42:22.403710 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 391/757] 10.222.0.64 () {58 vars in 1217 bytes} [Mon Jun 27 09:42:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-189199838 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:42:22.565255 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-d1b48db0-458f-4d40-8ff6-b33a4ccf07e9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:22.565890 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-d1b48db0-458f-4d40-8ff6-b33a4ccf07e9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:22.571891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d1b48db0-458f-4d40-8ff6-b33a4ccf07e9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:22.572336 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d1b48db0-458f-4d40-8ff6-b33a4ccf07e9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:22.573093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d1b48db0-458f-4d40-8ff6-b33a4ccf07e9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:22.574045 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d1b48db0-458f-4d40-8ff6-b33a4ccf07e9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:22.721378 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d1b48db0-458f-4d40-8ff6-b33a4ccf07e9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:22.729880 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d1b48db0-458f-4d40-8ff6-b33a4ccf07e9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:22.731486 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d1b48db0-458f-4d40-8ff6-b33a4ccf07e9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:22.732761 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-d1b48db0-458f-4d40-8ff6-b33a4ccf07e9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1721 microversion: 2.20 time: 0.171440 Jun 27 09:42:22.733464 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 367/758] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:22 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:23.117323 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-588c36e0-608e-4435-9287-e24f6ec3b1a3 req-e1aa401e-aaf6-4268-a77c-1b41110538ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "448074d1-f23d-4254-a9ec-26b00bd1298c", "name": "network-vif-unplugged", "status": "completed", "tag": "55e62be6-d365-40b9-9f9d-24357beba5b2"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:42:23.128503 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-588c36e0-608e-4435-9287-e24f6ec3b1a3 req-e1aa401e-aaf6-4268-a77c-1b41110538ea service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:23.128971 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-588c36e0-608e-4435-9287-e24f6ec3b1a3 req-e1aa401e-aaf6-4268-a77c-1b41110538ea service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:23.140370 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-588c36e0-608e-4435-9287-e24f6ec3b1a3 req-e1aa401e-aaf6-4268-a77c-1b41110538ea service nova] Creating event network-vif-unplugged:55e62be6-d365-40b9-9f9d-24357beba5b2 for instance 448074d1-f23d-4254-a9ec-26b00bd1298c on hv-cinder-84773 Jun 27 09:42:23.145287 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-588c36e0-608e-4435-9287-e24f6ec3b1a3 req-e1aa401e-aaf6-4268-a77c-1b41110538ea service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034622 Jun 27 09:42:23.146684 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 392/759] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:42:23.369854 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-fbb875fb-c241-4ae7-b9c5-b69ed755cd51 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Action: 'create', calling method: .version_select at 0x7ffa97390e50>, body: {"keypair": {"name": "tempest-keypair-1099739914", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2YQCdcPrilRxGRIZm5YMqWjfTpLHVn6LNZz9/NO79wEkZ8TX8b6vnXDIarWsiDznodp1qcrTUzrxOE5SWnUyClH1EDaN2A0smVBrQ6Oi1q9V4c4YjCUgVI32P6PYAcXg=="}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:42:23.384825 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-fbb875fb-c241-4ae7-b9c5-b69ed755cd51 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Getting quotas for project 4b698ead017b4ef8b397ee127b487309. Resources: {'key_pairs'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:42:23.388664 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-fbb875fb-c241-4ae7-b9c5-b69ed755cd51 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Getting quotas for user cc8a087e97424d2890952be33695378f and project 4b698ead017b4ef8b397ee127b487309. Resources: {'key_pairs'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:42:23.500352 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-fbb875fb-c241-4ae7-b9c5-b69ed755cd51 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134413 Jun 27 09:42:23.500950 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 368/760] 10.222.0.64 () {60 vars in 1158 bytes} [Mon Jun 27 09:42:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:42:23.751209 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-4370b89b-a71c-4f34-a5d3-141b34badcf0 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:23.751874 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-4370b89b-a71c-4f34-a5d3-141b34badcf0 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:23.758143 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4370b89b-a71c-4f34-a5d3-141b34badcf0 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:23.758612 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4370b89b-a71c-4f34-a5d3-141b34badcf0 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:23.759502 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4370b89b-a71c-4f34-a5d3-141b34badcf0 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:23.759970 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4370b89b-a71c-4f34-a5d3-141b34badcf0 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:23.925518 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4370b89b-a71c-4f34-a5d3-141b34badcf0 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:23.933502 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4370b89b-a71c-4f34-a5d3-141b34badcf0 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:23.934982 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4370b89b-a71c-4f34-a5d3-141b34badcf0 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:23.936151 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-4370b89b-a71c-4f34-a5d3-141b34badcf0 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1721 microversion: 2.20 time: 0.189830 Jun 27 09:42:23.936702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 393/761] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:23 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:24.955502 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e3d84dfa-9f04-4438-b14a-ca100848d5dc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:24.956139 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e3d84dfa-9f04-4438-b14a-ca100848d5dc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:24.962889 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e3d84dfa-9f04-4438-b14a-ca100848d5dc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:24.963344 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e3d84dfa-9f04-4438-b14a-ca100848d5dc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:24.964122 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e3d84dfa-9f04-4438-b14a-ca100848d5dc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:24.964575 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e3d84dfa-9f04-4438-b14a-ca100848d5dc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:25.129830 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-e3d84dfa-9f04-4438-b14a-ca100848d5dc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:25.139752 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-e3d84dfa-9f04-4438-b14a-ca100848d5dc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:25.141571 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-e3d84dfa-9f04-4438-b14a-ca100848d5dc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:25.143086 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e3d84dfa-9f04-4438-b14a-ca100848d5dc tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1664 microversion: 2.20 time: 0.191936 Jun 27 09:42:25.157328 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 369/762] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:24 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1664 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:25.163673 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-ded34b33-06d1-4e5f-9212-216135bb4e7b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0d7260d-e2ec-448d-b73f-60890a7ca50e"}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:42:25.166394 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-ded34b33-06d1-4e5f-9212-216135bb4e7b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:25.172731 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ded34b33-06d1-4e5f-9212-216135bb4e7b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:25.173185 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ded34b33-06d1-4e5f-9212-216135bb4e7b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:25.173998 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ded34b33-06d1-4e5f-9212-216135bb4e7b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:25.174437 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ded34b33-06d1-4e5f-9212-216135bb4e7b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:25.976209 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-843ad7f1-77d1-4dcd-9690-d837b18a5e6f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-45636577", "imageRef": "96dfa32c-d52f-4225-8918-743ebc97f4bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "44332445-ecaa-4205-9b0a-eb56bcdc88ee"}], "security_groups": [{"name": "tempest-securitygroup--688631333"}], "key_name": "tempest-keypair-1099739914", "user_data": "}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:42:26.078806 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.network.neutron [None req-843ad7f1-77d1-4dcd-9690-d837b18a5e6f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] validate_networks() for [('44332445-ecaa-4205-9b0a-eb56bcdc88ee', None, None, None, None, None)] {{(pid=124870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 09:42:26.189714 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-ded34b33-06d1-4e5f-9212-216135bb4e7b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "POST /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.025190 Jun 27 09:42:26.199804 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 394/763] 10.222.0.64 () {62 vars in 1363 bytes} [Mon Jun 27 09:42:25 2022] POST /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c/os-volume_attachments => generated 188 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 09:42:26.325412 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-8a413093-71df-4015-9a99-1e8a0ee62269 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:26.325939 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-8a413093-71df-4015-9a99-1e8a0ee62269 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:26.332783 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8a413093-71df-4015-9a99-1e8a0ee62269 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:26.333236 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8a413093-71df-4015-9a99-1e8a0ee62269 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:26.334030 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8a413093-71df-4015-9a99-1e8a0ee62269 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:26.334463 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8a413093-71df-4015-9a99-1e8a0ee62269 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:26.669398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-843ad7f1-77d1-4dcd-9690-d837b18a5e6f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Flavor limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 09:42:26.669825 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-843ad7f1-77d1-4dcd-9690-d837b18a5e6f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Image limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 09:42:26.670305 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-843ad7f1-77d1-4dcd-9690-d837b18a5e6f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Flavor pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 09:42:26.670714 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-843ad7f1-77d1-4dcd-9690-d837b18a5e6f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Image pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 09:42:26.671154 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-843ad7f1-77d1-4dcd-9690-d837b18a5e6f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 09:42:26.680286 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-843ad7f1-77d1-4dcd-9690-d837b18a5e6f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:26.680745 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-843ad7f1-77d1-4dcd-9690-d837b18a5e6f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:26.681537 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-843ad7f1-77d1-4dcd-9690-d837b18a5e6f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:26.682007 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-843ad7f1-77d1-4dcd-9690-d837b18a5e6f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:26.698696 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-843ad7f1-77d1-4dcd-9690-d837b18a5e6f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Getting quotas for project 4b698ead017b4ef8b397ee127b487309. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:42:26.702747 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-843ad7f1-77d1-4dcd-9690-d837b18a5e6f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Getting quotas for user cc8a087e97424d2890952be33695378f and project 4b698ead017b4ef8b397ee127b487309. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:42:26.714217 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-843ad7f1-77d1-4dcd-9690-d837b18a5e6f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Going to run 1 instances... {{(pid=124870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 09:42:26.716632 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-843ad7f1-77d1-4dcd-9690-d837b18a5e6f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96dfa32c-d52f-4225-8918-743ebc97f4bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 09:42:26.882237 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-843ad7f1-77d1-4dcd-9690-d837b18a5e6f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.910211 Jun 27 09:42:26.883207 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 370/764] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 27 09:42:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 09:42:26.892829 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-d8c1b050-3f4c-499f-ac54-739fb60ac1f2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:26.893441 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-d8c1b050-3f4c-499f-ac54-739fb60ac1f2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:26.907073 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:26.950684 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d8c1b050-3f4c-499f-ac54-739fb60ac1f2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:26.958050 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-d8c1b050-3f4c-499f-ac54-739fb60ac1f2 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 200 len: 1240 microversion: 2.1 time: 0.068881 Jun 27 09:42:26.968174 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 371/765] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:26 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:42:26.979497 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-8a413093-71df-4015-9a99-1e8a0ee62269 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "DELETE /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c/os-volume_attachments/f0d7260d-e2ec-448d-b73f-60890a7ca50e" status: 202 len: 0 microversion: 2.20 time: 0.658156 Jun 27 09:42:26.980509 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 395/766] 10.222.0.64 () {60 vars in 1456 bytes} [Mon Jun 27 09:42:26 2022] DELETE /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c/os-volume_attachments/f0d7260d-e2ec-448d-b73f-60890a7ca50e => generated 0 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 27 09:42:27.046355 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-00caf3c0-bbd5-4269-a738-cc9b0ab90166 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:42:27.046939 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-00caf3c0-bbd5-4269-a738-cc9b0ab90166 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:27.056588 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-00caf3c0-bbd5-4269-a738-cc9b0ab90166 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:27.057042 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-00caf3c0-bbd5-4269-a738-cc9b0ab90166 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:27.058703 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-00caf3c0-bbd5-4269-a738-cc9b0ab90166 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:27.059154 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-00caf3c0-bbd5-4269-a738-cc9b0ab90166 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:27.323613 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-00caf3c0-bbd5-4269-a738-cc9b0ab90166 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "POST /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c/action" status: 202 len: 0 microversion: 2.20 time: 0.282634 Jun 27 09:42:27.324170 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 372/767] 10.222.0.64 () {62 vars in 1318 bytes} [Mon Jun 27 09:42:27 2022] POST /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 09:42:27.332624 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f6257f03-f69f-4dba-b1c1-72b8028e6b10 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:27.333239 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-f6257f03-f69f-4dba-b1c1-72b8028e6b10 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:27.341421 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f6257f03-f69f-4dba-b1c1-72b8028e6b10 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:27.341894 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f6257f03-f69f-4dba-b1c1-72b8028e6b10 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:27.343117 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f6257f03-f69f-4dba-b1c1-72b8028e6b10 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:27.343754 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f6257f03-f69f-4dba-b1c1-72b8028e6b10 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:27.478630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f6257f03-f69f-4dba-b1c1-72b8028e6b10 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:27.487318 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f6257f03-f69f-4dba-b1c1-72b8028e6b10 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:27.488995 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f6257f03-f69f-4dba-b1c1-72b8028e6b10 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:27.490157 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-f6257f03-f69f-4dba-b1c1-72b8028e6b10 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1672 microversion: 2.20 time: 0.161839 Jun 27 09:42:27.490938 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 396/768] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:27 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:27.979010 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-84ef0366-7df5-4ae1-bd1b-daedf5199d0c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:27.980056 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-84ef0366-7df5-4ae1-bd1b-daedf5199d0c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:27.986258 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-84ef0366-7df5-4ae1-bd1b-daedf5199d0c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:27.986711 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-84ef0366-7df5-4ae1-bd1b-daedf5199d0c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:27.987490 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-84ef0366-7df5-4ae1-bd1b-daedf5199d0c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:27.987955 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-84ef0366-7df5-4ae1-bd1b-daedf5199d0c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:28.051028 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-84ef0366-7df5-4ae1-bd1b-daedf5199d0c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:28.060474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-84ef0366-7df5-4ae1-bd1b-daedf5199d0c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 200 len: 1244 microversion: 2.1 time: 0.087828 Jun 27 09:42:28.061046 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 373/769] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:27 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:28.508658 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-26e98db3-c567-45e6-8c03-627588d5cab1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:28.509355 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-26e98db3-c567-45e6-8c03-627588d5cab1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:28.516231 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-26e98db3-c567-45e6-8c03-627588d5cab1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:28.516765 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-26e98db3-c567-45e6-8c03-627588d5cab1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:28.517599 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-26e98db3-c567-45e6-8c03-627588d5cab1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:28.518034 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-26e98db3-c567-45e6-8c03-627588d5cab1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:28.670448 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-26e98db3-c567-45e6-8c03-627588d5cab1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:28.678618 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-26e98db3-c567-45e6-8c03-627588d5cab1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:28.680079 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-26e98db3-c567-45e6-8c03-627588d5cab1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:28.681235 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-26e98db3-c567-45e6-8c03-627588d5cab1 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1672 microversion: 2.20 time: 0.176744 Jun 27 09:42:28.681779 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 397/770] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:28 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1672 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:29.077297 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-aac841ca-1047-4fc0-a2fb-12be6e200e17 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:29.077901 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-aac841ca-1047-4fc0-a2fb-12be6e200e17 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:29.083791 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-aac841ca-1047-4fc0-a2fb-12be6e200e17 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:29.090665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-aac841ca-1047-4fc0-a2fb-12be6e200e17 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:29.090665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-aac841ca-1047-4fc0-a2fb-12be6e200e17 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:29.090665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-aac841ca-1047-4fc0-a2fb-12be6e200e17 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:29.100426 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:29.155103 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-aac841ca-1047-4fc0-a2fb-12be6e200e17 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:29.164057 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-aac841ca-1047-4fc0-a2fb-12be6e200e17 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 200 len: 1292 microversion: 2.1 time: 0.090995 Jun 27 09:42:29.165361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 374/771] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:29 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 1292 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:29.700310 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-4ff5e98d-af83-4d1f-b52a-f56a22a22a4f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:29.702703 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-4ff5e98d-af83-4d1f-b52a-f56a22a22a4f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:29.708488 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4ff5e98d-af83-4d1f-b52a-f56a22a22a4f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:29.709173 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4ff5e98d-af83-4d1f-b52a-f56a22a22a4f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:29.710101 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4ff5e98d-af83-4d1f-b52a-f56a22a22a4f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:29.710841 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4ff5e98d-af83-4d1f-b52a-f56a22a22a4f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:29.929071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4ff5e98d-af83-4d1f-b52a-f56a22a22a4f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:29.947549 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4ff5e98d-af83-4d1f-b52a-f56a22a22a4f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:29.953333 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4ff5e98d-af83-4d1f-b52a-f56a22a22a4f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:29.954532 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-4ff5e98d-af83-4d1f-b52a-f56a22a22a4f tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1730 microversion: 2.20 time: 0.258805 Jun 27 09:42:29.955096 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 398/772] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:29 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1730 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:30.183180 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c34578bc-f456-408e-8b03-cb7b8d7e6fb0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:30.183889 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-c34578bc-f456-408e-8b03-cb7b8d7e6fb0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:30.192041 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c34578bc-f456-408e-8b03-cb7b8d7e6fb0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:30.192503 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c34578bc-f456-408e-8b03-cb7b8d7e6fb0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:30.193429 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c34578bc-f456-408e-8b03-cb7b8d7e6fb0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:30.193876 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c34578bc-f456-408e-8b03-cb7b8d7e6fb0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:30.293242 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-c34578bc-f456-408e-8b03-cb7b8d7e6fb0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:30.303149 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-c34578bc-f456-408e-8b03-cb7b8d7e6fb0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 200 len: 1298 microversion: 2.1 time: 0.124505 Jun 27 09:42:30.304609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 375/773] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:30 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 1298 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:30.976982 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-fbd50ae6-13c4-4d1e-9e3b-ef35362f46a8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:30.977629 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-fbd50ae6-13c4-4d1e-9e3b-ef35362f46a8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:30.984571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fbd50ae6-13c4-4d1e-9e3b-ef35362f46a8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:30.985058 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fbd50ae6-13c4-4d1e-9e3b-ef35362f46a8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:30.985862 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fbd50ae6-13c4-4d1e-9e3b-ef35362f46a8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:30.986362 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fbd50ae6-13c4-4d1e-9e3b-ef35362f46a8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:31.127999 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-fbd50ae6-13c4-4d1e-9e3b-ef35362f46a8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:31.140247 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-fbd50ae6-13c4-4d1e-9e3b-ef35362f46a8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:31.142616 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-fbd50ae6-13c4-4d1e-9e3b-ef35362f46a8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:31.144132 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-fbd50ae6-13c4-4d1e-9e3b-ef35362f46a8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1730 microversion: 2.20 time: 0.171017 Jun 27 09:42:31.148003 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 399/774] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:30 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:31.320674 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-1e0f3d7e-e4aa-4fb6-8a46-de5055a30e57 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:31.321285 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-1e0f3d7e-e4aa-4fb6-8a46-de5055a30e57 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:31.329420 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1e0f3d7e-e4aa-4fb6-8a46-de5055a30e57 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:31.330656 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1e0f3d7e-e4aa-4fb6-8a46-de5055a30e57 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:31.331908 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1e0f3d7e-e4aa-4fb6-8a46-de5055a30e57 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:31.332643 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1e0f3d7e-e4aa-4fb6-8a46-de5055a30e57 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:31.658022 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-1e0f3d7e-e4aa-4fb6-8a46-de5055a30e57 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:31.674874 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-1e0f3d7e-e4aa-4fb6-8a46-de5055a30e57 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 200 len: 1365 microversion: 2.1 time: 0.357947 Jun 27 09:42:31.683782 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 376/775] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:31 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 1365 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:42:31.695025 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-6c6a2707-90d8-4b56-be97-5c75bd3cab44 req-a3352889-3035-47b7-8b75-9f138e89b675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00cfa885-ac09-465b-a052-7ea258517d6d", "tag": "72ec9bf0-624a-42fd-8729-9acf6b562b8d"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:42:31.707467 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-6c6a2707-90d8-4b56-be97-5c75bd3cab44 req-a3352889-3035-47b7-8b75-9f138e89b675 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:31.708366 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-6c6a2707-90d8-4b56-be97-5c75bd3cab44 req-a3352889-3035-47b7-8b75-9f138e89b675 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:31.746749 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-6c6a2707-90d8-4b56-be97-5c75bd3cab44 req-a3352889-3035-47b7-8b75-9f138e89b675 service nova] Creating event network-changed:72ec9bf0-624a-42fd-8729-9acf6b562b8d for instance 00cfa885-ac09-465b-a052-7ea258517d6d on hv-cinder-84773 Jun 27 09:42:31.752658 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-6c6a2707-90d8-4b56-be97-5c75bd3cab44 req-a3352889-3035-47b7-8b75-9f138e89b675 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061165 Jun 27 09:42:31.753251 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 400/776] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:42:32.163205 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-d2d26b92-7614-4073-b970-5e813bf3466a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:32.164204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-d2d26b92-7614-4073-b970-5e813bf3466a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:32.171885 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d2d26b92-7614-4073-b970-5e813bf3466a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:32.172479 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d2d26b92-7614-4073-b970-5e813bf3466a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:32.180022 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d2d26b92-7614-4073-b970-5e813bf3466a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:32.180022 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d2d26b92-7614-4073-b970-5e813bf3466a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:32.366811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d2d26b92-7614-4073-b970-5e813bf3466a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:32.376270 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d2d26b92-7614-4073-b970-5e813bf3466a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:32.378326 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d2d26b92-7614-4073-b970-5e813bf3466a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:32.379781 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-d2d26b92-7614-4073-b970-5e813bf3466a tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1730 microversion: 2.20 time: 0.221060 Jun 27 09:42:32.380622 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 377/777] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:32 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1730 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:32.700662 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-6408cb95-53a2-421b-8468-fe72aa70964c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:32.701415 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-6408cb95-53a2-421b-8468-fe72aa70964c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:32.710423 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6408cb95-53a2-421b-8468-fe72aa70964c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:32.712209 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6408cb95-53a2-421b-8468-fe72aa70964c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:32.713201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6408cb95-53a2-421b-8468-fe72aa70964c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:32.713745 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6408cb95-53a2-421b-8468-fe72aa70964c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:32.890950 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6408cb95-53a2-421b-8468-fe72aa70964c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:32.904976 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-6408cb95-53a2-421b-8468-fe72aa70964c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 200 len: 1365 microversion: 2.1 time: 0.209605 Jun 27 09:42:32.906170 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 401/778] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:32 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:33.402310 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-610ca7bc-4aac-498f-9511-3d0e82437a9d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:33.402919 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-610ca7bc-4aac-498f-9511-3d0e82437a9d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:33.411163 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-610ca7bc-4aac-498f-9511-3d0e82437a9d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:33.412084 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-610ca7bc-4aac-498f-9511-3d0e82437a9d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:33.413110 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-610ca7bc-4aac-498f-9511-3d0e82437a9d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:33.413748 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-610ca7bc-4aac-498f-9511-3d0e82437a9d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:33.433359 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-471a817a-599f-47e2-a388-a1ebd748bf72 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:33.434181 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-471a817a-599f-47e2-a388-a1ebd748bf72 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:33.446089 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-471a817a-599f-47e2-a388-a1ebd748bf72 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:33.447570 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-471a817a-599f-47e2-a388-a1ebd748bf72 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:33.448827 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-471a817a-599f-47e2-a388-a1ebd748bf72 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:33.452468 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-471a817a-599f-47e2-a388-a1ebd748bf72 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:33.502797 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-471a817a-599f-47e2-a388-a1ebd748bf72 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Going to try to terminate instance {{(pid=124869) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 09:42:33.605705 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-610ca7bc-4aac-498f-9511-3d0e82437a9d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:33.634643 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-610ca7bc-4aac-498f-9511-3d0e82437a9d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:33.636839 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-610ca7bc-4aac-498f-9511-3d0e82437a9d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:33.645084 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-610ca7bc-4aac-498f-9511-3d0e82437a9d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1730 microversion: 2.20 time: 0.248145 Jun 27 09:42:33.645680 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 378/779] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:33 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1730 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:33.846708 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-471a817a-599f-47e2-a388-a1ebd748bf72 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 204 len: 0 microversion: 2.1 time: 0.416847 Jun 27 09:42:33.847362 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 402/780] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:42:33 2022] DELETE /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 09:42:33.859333 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-3398e057-4e3f-465f-9206-fdfa780f4002 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:33.860269 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-3398e057-4e3f-465f-9206-fdfa780f4002 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:33.867571 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3398e057-4e3f-465f-9206-fdfa780f4002 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:33.868452 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3398e057-4e3f-465f-9206-fdfa780f4002 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:33.871029 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3398e057-4e3f-465f-9206-fdfa780f4002 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:33.871928 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3398e057-4e3f-465f-9206-fdfa780f4002 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:33.924564 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-55329489-177e-40a7-9ff5-8070438834f7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:33.925523 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-55329489-177e-40a7-9ff5-8070438834f7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:33.937099 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-55329489-177e-40a7-9ff5-8070438834f7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:33.937559 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-55329489-177e-40a7-9ff5-8070438834f7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:33.943206 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-55329489-177e-40a7-9ff5-8070438834f7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:33.944694 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-55329489-177e-40a7-9ff5-8070438834f7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:34.093391 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-3398e057-4e3f-465f-9206-fdfa780f4002 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:34.102286 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-3398e057-4e3f-465f-9206-fdfa780f4002 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1576 microversion: 2.1 time: 0.249803 Jun 27 09:42:34.102914 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 379/781] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:33 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1576 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:42:34.116785 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-55329489-177e-40a7-9ff5-8070438834f7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:34.124995 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-55329489-177e-40a7-9ff5-8070438834f7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 200 len: 1365 microversion: 2.1 time: 0.205739 Jun 27 09:42:34.125559 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 403/782] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:33 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 1365 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:42:34.663863 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-540c947a-8f88-4dc0-8e72-548b85441f05 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:34.664510 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-540c947a-8f88-4dc0-8e72-548b85441f05 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:34.673398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-540c947a-8f88-4dc0-8e72-548b85441f05 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:34.673995 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-540c947a-8f88-4dc0-8e72-548b85441f05 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:34.674891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-540c947a-8f88-4dc0-8e72-548b85441f05 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:34.675429 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-540c947a-8f88-4dc0-8e72-548b85441f05 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:34.835092 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-540c947a-8f88-4dc0-8e72-548b85441f05 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:34.849768 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-540c947a-8f88-4dc0-8e72-548b85441f05 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:34.852195 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-540c947a-8f88-4dc0-8e72-548b85441f05 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:34.853714 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-540c947a-8f88-4dc0-8e72-548b85441f05 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1730 microversion: 2.20 time: 0.194131 Jun 27 09:42:34.855644 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 380/783] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:34 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:35.120521 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-81dfb75e-993b-40a6-aa97-84d02aaf5ba4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:35.121199 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-81dfb75e-993b-40a6-aa97-84d02aaf5ba4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:35.123859 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:35.128769 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-81dfb75e-993b-40a6-aa97-84d02aaf5ba4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:35.129221 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-81dfb75e-993b-40a6-aa97-84d02aaf5ba4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:35.129984 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-81dfb75e-993b-40a6-aa97-84d02aaf5ba4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:35.130428 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-81dfb75e-993b-40a6-aa97-84d02aaf5ba4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:35.141526 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-bffcc45b-2c3a-45a3-8369-b5ca4ed210e5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:35.142188 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-bffcc45b-2c3a-45a3-8369-b5ca4ed210e5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:35.148709 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-bffcc45b-2c3a-45a3-8369-b5ca4ed210e5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:35.149236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-bffcc45b-2c3a-45a3-8369-b5ca4ed210e5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:35.150029 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-bffcc45b-2c3a-45a3-8369-b5ca4ed210e5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:35.150462 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-bffcc45b-2c3a-45a3-8369-b5ca4ed210e5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:35.282433 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-81dfb75e-993b-40a6-aa97-84d02aaf5ba4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:35.291357 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-81dfb75e-993b-40a6-aa97-84d02aaf5ba4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1576 microversion: 2.1 time: 0.174769 Jun 27 09:42:35.292130 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 404/784] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:35 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:35.301960 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-bffcc45b-2c3a-45a3-8369-b5ca4ed210e5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:35.309269 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-bffcc45b-2c3a-45a3-8369-b5ca4ed210e5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 200 len: 1365 microversion: 2.1 time: 0.171465 Jun 27 09:42:35.309834 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 381/785] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:35 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:42:35.874557 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-9987bc84-6a7e-4d1f-b502-2513556c82b8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:35.875246 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-9987bc84-6a7e-4d1f-b502-2513556c82b8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:35.890067 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9987bc84-6a7e-4d1f-b502-2513556c82b8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:35.890732 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9987bc84-6a7e-4d1f-b502-2513556c82b8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:35.891989 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9987bc84-6a7e-4d1f-b502-2513556c82b8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:35.892435 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9987bc84-6a7e-4d1f-b502-2513556c82b8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:36.068117 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-9987bc84-6a7e-4d1f-b502-2513556c82b8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:36.076668 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-9987bc84-6a7e-4d1f-b502-2513556c82b8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:36.082067 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-9987bc84-6a7e-4d1f-b502-2513556c82b8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:36.084310 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-9987bc84-6a7e-4d1f-b502-2513556c82b8 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1730 microversion: 2.20 time: 0.214697 Jun 27 09:42:36.085258 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 405/786] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:35 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1730 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:36.315763 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-36bb3a73-ce61-48d0-8493-7faa84074925 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:36.316543 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-36bb3a73-ce61-48d0-8493-7faa84074925 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:36.326540 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-346d936d-055b-4264-aa10-44b59f596ad6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:36.327970 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-346d936d-055b-4264-aa10-44b59f596ad6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:36.333091 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-36bb3a73-ce61-48d0-8493-7faa84074925 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:36.333579 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-36bb3a73-ce61-48d0-8493-7faa84074925 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:36.334649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-36bb3a73-ce61-48d0-8493-7faa84074925 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:36.335315 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-36bb3a73-ce61-48d0-8493-7faa84074925 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:36.337217 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-346d936d-055b-4264-aa10-44b59f596ad6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:36.337928 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-346d936d-055b-4264-aa10-44b59f596ad6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:36.339761 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-346d936d-055b-4264-aa10-44b59f596ad6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:36.340422 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-346d936d-055b-4264-aa10-44b59f596ad6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:36.528265 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-346d936d-055b-4264-aa10-44b59f596ad6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:36.536655 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-346d936d-055b-4264-aa10-44b59f596ad6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 200 len: 1365 microversion: 2.1 time: 0.214652 Jun 27 09:42:36.539128 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 406/787] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:36 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:36.551183 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-36bb3a73-ce61-48d0-8493-7faa84074925 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:36.559752 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-36bb3a73-ce61-48d0-8493-7faa84074925 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1576 microversion: 2.1 time: 0.253074 Jun 27 09:42:36.560594 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 382/788] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:36 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1576 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:37.105664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-6205c85d-7f4e-443a-8db2-260219dba99e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:37.106281 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-6205c85d-7f4e-443a-8db2-260219dba99e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:37.112752 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6205c85d-7f4e-443a-8db2-260219dba99e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:37.113384 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6205c85d-7f4e-443a-8db2-260219dba99e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:37.114173 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6205c85d-7f4e-443a-8db2-260219dba99e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:37.114615 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6205c85d-7f4e-443a-8db2-260219dba99e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:37.284013 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6205c85d-7f4e-443a-8db2-260219dba99e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:37.284013 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6205c85d-7f4e-443a-8db2-260219dba99e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:37.285380 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6205c85d-7f4e-443a-8db2-260219dba99e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:37.285380 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-6205c85d-7f4e-443a-8db2-260219dba99e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1730 microversion: 2.20 time: 0.154515 Jun 27 09:42:37.285380 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 407/789] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:37 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:37.556017 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-52135162-7bbf-4ccd-818e-dc07b182fb0c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:37.556751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-52135162-7bbf-4ccd-818e-dc07b182fb0c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:37.559243 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=2 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:37.560042 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=12 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:37.561221 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:37.566012 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-52135162-7bbf-4ccd-818e-dc07b182fb0c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:37.566468 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-52135162-7bbf-4ccd-818e-dc07b182fb0c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:37.567241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-52135162-7bbf-4ccd-818e-dc07b182fb0c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:37.567714 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-52135162-7bbf-4ccd-818e-dc07b182fb0c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:37.590303 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-39372674-9711-47af-8102-f7fdd91d53c4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:37.591635 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-39372674-9711-47af-8102-f7fdd91d53c4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:37.599510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-39372674-9711-47af-8102-f7fdd91d53c4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:37.600315 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-39372674-9711-47af-8102-f7fdd91d53c4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:37.601123 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-39372674-9711-47af-8102-f7fdd91d53c4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:37.601730 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-39372674-9711-47af-8102-f7fdd91d53c4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:37.746226 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-39372674-9711-47af-8102-f7fdd91d53c4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:37.753619 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-39372674-9711-47af-8102-f7fdd91d53c4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1576 microversion: 2.1 time: 0.173062 Jun 27 09:42:37.754425 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 408/790] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:37 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:37.770902 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-52135162-7bbf-4ccd-818e-dc07b182fb0c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:37.779438 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-52135162-7bbf-4ccd-818e-dc07b182fb0c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 200 len: 1365 microversion: 2.1 time: 0.227156 Jun 27 09:42:37.780403 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 383/791] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:37 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:38.283847 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-4c45bd45-94c4-4943-b6f4-ea3b7b23a7b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:38.284742 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-4c45bd45-94c4-4943-b6f4-ea3b7b23a7b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:38.293183 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4c45bd45-94c4-4943-b6f4-ea3b7b23a7b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:38.293871 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4c45bd45-94c4-4943-b6f4-ea3b7b23a7b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:38.294621 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4c45bd45-94c4-4943-b6f4-ea3b7b23a7b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:38.295124 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4c45bd45-94c4-4943-b6f4-ea3b7b23a7b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:38.469637 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4c45bd45-94c4-4943-b6f4-ea3b7b23a7b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:38.478548 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4c45bd45-94c4-4943-b6f4-ea3b7b23a7b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:38.480705 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4c45bd45-94c4-4943-b6f4-ea3b7b23a7b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:38.482007 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-4c45bd45-94c4-4943-b6f4-ea3b7b23a7b5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1730 microversion: 2.20 time: 0.204679 Jun 27 09:42:38.487572 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 409/792] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:38 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:38.783296 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-b422268e-442e-45e0-91d9-441db3f2c6b2 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:38.783926 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-b422268e-442e-45e0-91d9-441db3f2c6b2 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:38.794120 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b422268e-442e-45e0-91d9-441db3f2c6b2 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:38.794578 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b422268e-442e-45e0-91d9-441db3f2c6b2 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:38.795358 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b422268e-442e-45e0-91d9-441db3f2c6b2 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:38.795829 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b422268e-442e-45e0-91d9-441db3f2c6b2 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:38.797118 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-202b2dbb-504c-462a-8216-e9fcdc4422bd tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:38.797788 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-202b2dbb-504c-462a-8216-e9fcdc4422bd tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:38.804177 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-202b2dbb-504c-462a-8216-e9fcdc4422bd tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:38.804702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-202b2dbb-504c-462a-8216-e9fcdc4422bd tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:38.806610 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-202b2dbb-504c-462a-8216-e9fcdc4422bd tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:38.807103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-202b2dbb-504c-462a-8216-e9fcdc4422bd tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:38.943384 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-202b2dbb-504c-462a-8216-e9fcdc4422bd tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:38.951464 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-202b2dbb-504c-462a-8216-e9fcdc4422bd tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 200 len: 1365 microversion: 2.1 time: 0.158519 Jun 27 09:42:38.954628 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 410/793] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:38 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:42:38.974390 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-b422268e-442e-45e0-91d9-441db3f2c6b2 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:38.982088 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-b422268e-442e-45e0-91d9-441db3f2c6b2 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1576 microversion: 2.1 time: 0.203462 Jun 27 09:42:38.983250 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 384/794] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:38 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1576 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:39.500381 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-85b76579-f1a8-4e3a-bc80-42aebe442b14 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:39.500995 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-85b76579-f1a8-4e3a-bc80-42aebe442b14 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:39.506926 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-85b76579-f1a8-4e3a-bc80-42aebe442b14 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:39.507387 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-85b76579-f1a8-4e3a-bc80-42aebe442b14 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:39.508347 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-85b76579-f1a8-4e3a-bc80-42aebe442b14 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:39.508792 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-85b76579-f1a8-4e3a-bc80-42aebe442b14 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:39.526719 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:39.663848 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-85b76579-f1a8-4e3a-bc80-42aebe442b14 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:39.674617 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-85b76579-f1a8-4e3a-bc80-42aebe442b14 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:39.678279 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-85b76579-f1a8-4e3a-bc80-42aebe442b14 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:39.678279 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-85b76579-f1a8-4e3a-bc80-42aebe442b14 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1730 microversion: 2.20 time: 0.180841 Jun 27 09:42:39.693361 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 411/795] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:39 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:39.969036 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a1be1779-3378-4dbe-95d1-277a6e63dc21 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:39.969791 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-a1be1779-3378-4dbe-95d1-277a6e63dc21 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:39.977109 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a1be1779-3378-4dbe-95d1-277a6e63dc21 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:39.977561 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a1be1779-3378-4dbe-95d1-277a6e63dc21 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:39.978388 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a1be1779-3378-4dbe-95d1-277a6e63dc21 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:39.979349 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a1be1779-3378-4dbe-95d1-277a6e63dc21 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:40.000285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-b1110b5f-b707-4677-8258-e04d268d0daf tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:40.005886 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-b1110b5f-b707-4677-8258-e04d268d0daf tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:40.009580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b1110b5f-b707-4677-8258-e04d268d0daf tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:40.010366 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b1110b5f-b707-4677-8258-e04d268d0daf tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:40.017160 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b1110b5f-b707-4677-8258-e04d268d0daf tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:40.017741 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b1110b5f-b707-4677-8258-e04d268d0daf tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:40.163159 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a1be1779-3378-4dbe-95d1-277a6e63dc21 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:40.178226 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-a1be1779-3378-4dbe-95d1-277a6e63dc21 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 200 len: 1365 microversion: 2.1 time: 0.213861 Jun 27 09:42:40.189865 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 385/796] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:39 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:42:40.251349 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-b1110b5f-b707-4677-8258-e04d268d0daf tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:40.261437 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-b1110b5f-b707-4677-8258-e04d268d0daf tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1576 microversion: 2.1 time: 0.265411 Jun 27 09:42:40.271198 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 412/797] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:39 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1576 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:40.697310 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-98b33bca-e262-4f5d-ac2f-184a0ad58e43 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:40.704472 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-98b33bca-e262-4f5d-ac2f-184a0ad58e43 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:40.704621 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-98b33bca-e262-4f5d-ac2f-184a0ad58e43 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:40.705028 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-98b33bca-e262-4f5d-ac2f-184a0ad58e43 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:40.705984 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-98b33bca-e262-4f5d-ac2f-184a0ad58e43 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:40.706581 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-98b33bca-e262-4f5d-ac2f-184a0ad58e43 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:40.855472 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-98b33bca-e262-4f5d-ac2f-184a0ad58e43 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:40.863420 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-98b33bca-e262-4f5d-ac2f-184a0ad58e43 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:40.864936 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-98b33bca-e262-4f5d-ac2f-184a0ad58e43 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:40.866134 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-98b33bca-e262-4f5d-ac2f-184a0ad58e43 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1730 microversion: 2.20 time: 0.172647 Jun 27 09:42:40.866987 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 386/798] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:40 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:41.194948 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-aaf27586-f311-4e69-85a2-f301825b5205 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:41.195583 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-aaf27586-f311-4e69-85a2-f301825b5205 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:41.203242 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-aaf27586-f311-4e69-85a2-f301825b5205 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:41.203731 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-aaf27586-f311-4e69-85a2-f301825b5205 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:41.204501 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-aaf27586-f311-4e69-85a2-f301825b5205 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:41.204939 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-aaf27586-f311-4e69-85a2-f301825b5205 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:41.280921 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-0f2ea8a0-f221-4d2b-a684-4478c5f4f41e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:41.282898 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-0f2ea8a0-f221-4d2b-a684-4478c5f4f41e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:41.295129 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0f2ea8a0-f221-4d2b-a684-4478c5f4f41e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:41.295667 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0f2ea8a0-f221-4d2b-a684-4478c5f4f41e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:41.300994 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0f2ea8a0-f221-4d2b-a684-4478c5f4f41e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:41.300994 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0f2ea8a0-f221-4d2b-a684-4478c5f4f41e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:41.354191 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-aaf27586-f311-4e69-85a2-f301825b5205 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:41.362081 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-aaf27586-f311-4e69-85a2-f301825b5205 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 200 len: 1365 microversion: 2.1 time: 0.170908 Jun 27 09:42:41.362772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 413/799] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:41 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:41.447276 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-0f2ea8a0-f221-4d2b-a684-4478c5f4f41e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:41.455567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-0f2ea8a0-f221-4d2b-a684-4478c5f4f41e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1576 microversion: 2.1 time: 0.181196 Jun 27 09:42:41.464731 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 387/800] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:41 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:41.887043 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-5d16eead-3ccd-40b8-866e-17a74f276e6b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:41.887672 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-5d16eead-3ccd-40b8-866e-17a74f276e6b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:41.893855 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5d16eead-3ccd-40b8-866e-17a74f276e6b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:41.894344 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5d16eead-3ccd-40b8-866e-17a74f276e6b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:41.895101 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5d16eead-3ccd-40b8-866e-17a74f276e6b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:41.895548 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5d16eead-3ccd-40b8-866e-17a74f276e6b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:42.026675 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-5d16eead-3ccd-40b8-866e-17a74f276e6b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:42.034872 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-5d16eead-3ccd-40b8-866e-17a74f276e6b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:42.036440 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-5d16eead-3ccd-40b8-866e-17a74f276e6b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:42.037590 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-5d16eead-3ccd-40b8-866e-17a74f276e6b tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1730 microversion: 2.20 time: 0.155310 Jun 27 09:42:42.038145 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 414/801] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:41 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:42.378035 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e61e85ed-c07e-44d1-8ee9-693e5cc298e0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:42.378657 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e61e85ed-c07e-44d1-8ee9-693e5cc298e0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:42.387456 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e61e85ed-c07e-44d1-8ee9-693e5cc298e0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:42.387456 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e61e85ed-c07e-44d1-8ee9-693e5cc298e0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:42.387456 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e61e85ed-c07e-44d1-8ee9-693e5cc298e0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:42.387456 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e61e85ed-c07e-44d1-8ee9-693e5cc298e0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:42.473060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-59cca3fe-f8c0-4ebd-9588-59477b6a6628 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:42.473752 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-59cca3fe-f8c0-4ebd-9588-59477b6a6628 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:42.480992 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-59cca3fe-f8c0-4ebd-9588-59477b6a6628 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:42.481521 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-59cca3fe-f8c0-4ebd-9588-59477b6a6628 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:42.482304 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-59cca3fe-f8c0-4ebd-9588-59477b6a6628 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:42.482742 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-59cca3fe-f8c0-4ebd-9588-59477b6a6628 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:42.529272 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-e61e85ed-c07e-44d1-8ee9-693e5cc298e0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:42.538960 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e61e85ed-c07e-44d1-8ee9-693e5cc298e0 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 200 len: 1365 microversion: 2.1 time: 0.164309 Jun 27 09:42:42.540424 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 388/802] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:42 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:42.623829 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-59cca3fe-f8c0-4ebd-9588-59477b6a6628 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:42.631361 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-59cca3fe-f8c0-4ebd-9588-59477b6a6628 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1576 microversion: 2.1 time: 0.162711 Jun 27 09:42:42.632292 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 415/803] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:42 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:43.058172 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-b4da0555-1995-47de-8fc9-00b3058c39f7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:43.058999 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-b4da0555-1995-47de-8fc9-00b3058c39f7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:43.068123 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b4da0555-1995-47de-8fc9-00b3058c39f7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:43.068123 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b4da0555-1995-47de-8fc9-00b3058c39f7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:43.068364 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b4da0555-1995-47de-8fc9-00b3058c39f7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:43.068848 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b4da0555-1995-47de-8fc9-00b3058c39f7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:43.585722 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-b4da0555-1995-47de-8fc9-00b3058c39f7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:43.596358 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-b4da0555-1995-47de-8fc9-00b3058c39f7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:43.598984 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-b4da0555-1995-47de-8fc9-00b3058c39f7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:43.600549 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-b4da0555-1995-47de-8fc9-00b3058c39f7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1730 microversion: 2.20 time: 0.548331 Jun 27 09:42:43.601773 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 389/804] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:43 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1730 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:43.651052 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-d99fd25f-59b7-47b1-8b3b-4faf72686797 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:43.652219 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-d99fd25f-59b7-47b1-8b3b-4faf72686797 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:43.660235 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d99fd25f-59b7-47b1-8b3b-4faf72686797 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:43.661139 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d99fd25f-59b7-47b1-8b3b-4faf72686797 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:43.662445 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d99fd25f-59b7-47b1-8b3b-4faf72686797 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:43.663211 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d99fd25f-59b7-47b1-8b3b-4faf72686797 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:43.758254 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d99fd25f-59b7-47b1-8b3b-4faf72686797 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:43.768630 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-d99fd25f-59b7-47b1-8b3b-4faf72686797 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1508 microversion: 2.1 time: 0.123973 Jun 27 09:42:43.769385 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 390/805] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:43 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1508 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:43.789492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-a2cfc282-b2c1-4ae4-bd8e-f8fbf7b5d51e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:43.790112 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-a2cfc282-b2c1-4ae4-bd8e-f8fbf7b5d51e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:43.796985 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a2cfc282-b2c1-4ae4-bd8e-f8fbf7b5d51e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:43.797436 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a2cfc282-b2c1-4ae4-bd8e-f8fbf7b5d51e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:43.798239 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a2cfc282-b2c1-4ae4-bd8e-f8fbf7b5d51e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:43.798745 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a2cfc282-b2c1-4ae4-bd8e-f8fbf7b5d51e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:44.004140 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-a2cfc282-b2c1-4ae4-bd8e-f8fbf7b5d51e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:44.011722 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-a2cfc282-b2c1-4ae4-bd8e-f8fbf7b5d51e tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 200 len: 1365 microversion: 2.1 time: 0.458349 Jun 27 09:42:44.012335 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 416/806] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:43 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 1365 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:44.417776 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-7e27d8d6-45fc-4d3c-9ce3-7ca83f3faba7 req-a4379583-5192-43ce-b5e2-a8e22d781d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cb9074b-9ac1-4780-ab45-dde1641b83e3", "name": "network-vif-deleted", "tag": "6668e5f8-1a3b-4d07-a99b-2feabc1b8262"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:42:44.426359 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-7e27d8d6-45fc-4d3c-9ce3-7ca83f3faba7 req-a4379583-5192-43ce-b5e2-a8e22d781d38 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:44.426803 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-7e27d8d6-45fc-4d3c-9ce3-7ca83f3faba7 req-a4379583-5192-43ce-b5e2-a8e22d781d38 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:44.430747 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=100 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:44.438856 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-7e27d8d6-45fc-4d3c-9ce3-7ca83f3faba7 req-a4379583-5192-43ce-b5e2-a8e22d781d38 service nova] Creating event network-vif-deleted:6668e5f8-1a3b-4d07-a99b-2feabc1b8262 for instance 3cb9074b-9ac1-4780-ab45-dde1641b83e3 on hv-cinder-84773 Jun 27 09:42:44.446710 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-7e27d8d6-45fc-4d3c-9ce3-7ca83f3faba7 req-a4379583-5192-43ce-b5e2-a8e22d781d38 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089947 Jun 27 09:42:44.446710 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 391/807] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:42:44.622362 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-32a900ba-9397-4472-bf8f-874b38dea4f2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:44.623260 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-32a900ba-9397-4472-bf8f-874b38dea4f2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:44.630783 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-32a900ba-9397-4472-bf8f-874b38dea4f2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:44.632123 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-32a900ba-9397-4472-bf8f-874b38dea4f2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:44.632899 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-32a900ba-9397-4472-bf8f-874b38dea4f2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:44.633497 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-32a900ba-9397-4472-bf8f-874b38dea4f2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:44.769438 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-32a900ba-9397-4472-bf8f-874b38dea4f2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:44.777952 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-32a900ba-9397-4472-bf8f-874b38dea4f2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:44.779443 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-32a900ba-9397-4472-bf8f-874b38dea4f2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:44.780630 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-32a900ba-9397-4472-bf8f-874b38dea4f2 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1730 microversion: 2.20 time: 0.164511 Jun 27 09:42:44.781256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 417/808] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:44 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 09:42:44.787246 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-2face3b9-48b3-49e3-92d7-bb1c4a6d87b8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:44.788390 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-2face3b9-48b3-49e3-92d7-bb1c4a6d87b8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:44.795858 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2face3b9-48b3-49e3-92d7-bb1c4a6d87b8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:44.799855 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2face3b9-48b3-49e3-92d7-bb1c4a6d87b8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:44.799855 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2face3b9-48b3-49e3-92d7-bb1c4a6d87b8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:44.799855 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2face3b9-48b3-49e3-92d7-bb1c4a6d87b8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:44.872566 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-2face3b9-48b3-49e3-92d7-bb1c4a6d87b8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:44.880538 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-2face3b9-48b3-49e3-92d7-bb1c4a6d87b8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 200 len: 1225 microversion: 2.1 time: 0.097944 Jun 27 09:42:44.881107 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 392/809] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:44 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:45.029808 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-13404b33-1f5b-4cdb-86e9-335057b7fcf5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:45.030980 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-13404b33-1f5b-4cdb-86e9-335057b7fcf5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:45.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-13404b33-1f5b-4cdb-86e9-335057b7fcf5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:45.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-13404b33-1f5b-4cdb-86e9-335057b7fcf5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:45.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-13404b33-1f5b-4cdb-86e9-335057b7fcf5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:45.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-13404b33-1f5b-4cdb-86e9-335057b7fcf5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:45.212876 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-13404b33-1f5b-4cdb-86e9-335057b7fcf5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:45.223269 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-13404b33-1f5b-4cdb-86e9-335057b7fcf5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 200 len: 1365 microversion: 2.1 time: 0.198136 Jun 27 09:42:45.224061 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 418/810] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:45 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:42:45.392402 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-6234425d-9ddb-4c04-8bc9-ea3532b1c66c req-4e3ce021-f238-44a3-9aa1-022464548697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "448074d1-f23d-4254-a9ec-26b00bd1298c", "name": "network-vif-plugged", "status": "completed", "tag": "55e62be6-d365-40b9-9f9d-24357beba5b2"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:42:45.402390 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-6234425d-9ddb-4c04-8bc9-ea3532b1c66c req-4e3ce021-f238-44a3-9aa1-022464548697 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:45.403104 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-6234425d-9ddb-4c04-8bc9-ea3532b1c66c req-4e3ce021-f238-44a3-9aa1-022464548697 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:45.416865 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-6234425d-9ddb-4c04-8bc9-ea3532b1c66c req-4e3ce021-f238-44a3-9aa1-022464548697 service nova] Creating event network-vif-plugged:55e62be6-d365-40b9-9f9d-24357beba5b2 for instance 448074d1-f23d-4254-a9ec-26b00bd1298c on hv-cinder-84773 Jun 27 09:42:45.422146 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-6234425d-9ddb-4c04-8bc9-ea3532b1c66c req-4e3ce021-f238-44a3-9aa1-022464548697 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033639 Jun 27 09:42:45.422731 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 393/811] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:42:45.798654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-ceae178a-d214-4768-8cfb-162162897cb9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:45.799266 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-ceae178a-d214-4768-8cfb-162162897cb9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:45.805834 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ceae178a-d214-4768-8cfb-162162897cb9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:45.806195 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ceae178a-d214-4768-8cfb-162162897cb9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:45.807863 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ceae178a-d214-4768-8cfb-162162897cb9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:45.808467 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ceae178a-d214-4768-8cfb-162162897cb9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:45.897927 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-99403573-6eb5-4e02-a3f3-df26b795ba56 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:45.898627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-99403573-6eb5-4e02-a3f3-df26b795ba56 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:45.913758 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-99403573-6eb5-4e02-a3f3-df26b795ba56 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:45.913758 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-99403573-6eb5-4e02-a3f3-df26b795ba56 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:45.914002 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-99403573-6eb5-4e02-a3f3-df26b795ba56 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:45.914379 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-99403573-6eb5-4e02-a3f3-df26b795ba56 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:45.929159 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-99403573-6eb5-4e02-a3f3-df26b795ba56 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] HTTP exception thrown: Instance 3cb9074b-9ac1-4780-ab45-dde1641b83e3 could not be found. Jun 27 09:42:45.930824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-99403573-6eb5-4e02-a3f3-df26b795ba56 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Request method failure captured: Jun 27 09:42:45.930824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 HTTP/1.1 Jun 27 09:42:45.930824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:42:45.930824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:42:45.930824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:42:45.930824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:42:45.930824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:42:45.930824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:42:45.930824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:42:45.930824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:42:45.930824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXrKJ0sl3youQvE_D_4Ht9u2HFsuYgBgTX6DegLCY_ccCw9Axr0Yw4ikyfrNS517XJKQhYV2ERTEEf23rjHye8Ux6C2rJtHLtDMZ7Wq9N4_MQ2vz1k1OBPJPdykHjY6P2Oh1_dmZ71fy3x7unHYIPtq-CmCyHxPLeZiIJNvhMR3swsA Jun 27 09:42:45.930824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:42:45.930824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:42:45.930824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:42:45.930824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:42:45.930824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:42:45.930824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:42:45.930824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: 1d5cbd080e204408aa51c29ec2cf1422 Jun 27 09:42:45.930824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-TestVolumeBootPattern-611261078 Jun 27 09:42:45.930824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:42:45.930824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:42:45.933290 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1d5cbd080e204408aa51c29ec2cf1422"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1d5cbd080e204408aa51c29ec2cf1422"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1d5cbd080e204408aa51c29ec2cf1422"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1d5cbd080e204408aa51c29ec2cf1422", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:42:45.933290 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-TestVolumeBootPattern-611261078 Jun 27 09:42:45.933290 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: 1d5cbd080e204408aa51c29ec2cf1422 Jun 27 09:42:45.933290 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-TestVolumeBootPattern-611261078 Jun 27 09:42:45.933290 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-TestVolumeBootPattern-611261078-project Jun 27 09:42:45.933290 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:42:45.933290 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:42:45.933290 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: 2720d45854ab4a61b3b22dd43a523d4b Jun 27 09:42:45.933290 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-TestVolumeBootPattern-611261078-project Jun 27 09:42:45.933290 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: > Jun 27 09:42:45.933290 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Instance 3cb9074b-9ac1-4780-ab45-dde1641b83e3 could not be found. Jun 27 09:42:45.933290 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': '3cb9074b-9ac1-4780-ab45-dde1641b83e3'} Jun 27 09:42:45.936814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:42:45.936814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:42:45.936814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:42:45.936814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:42:45.936814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:42:45.936814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:42:45.936814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:42:45.936814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:42:45.936814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:42:45.936814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:42:45.936814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cb9074b-9ac1-4780-ab45-dde1641b83e3 could not be found. Jun 27 09:42:45.936814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:42:45.936814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:42:45.936814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:42:45.936814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:42:45.936814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:42:45.936814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:42:45.936814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:42:45.936814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:42:45.936814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:42:45.938673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:42:45.938673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:42:45.938673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:42:45.938673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:42:45.938673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:42:45.938673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:42:45.938673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:42:45.938673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cb9074b-9ac1-4780-ab45-dde1641b83e3 could not be found. Jun 27 09:42:45.938673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:42:45.938673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:42:45.938673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:42:45.938673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:42:45.938673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:42:45.938673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:42:45.938673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:42:45.938673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:42:45.938673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cb9074b-9ac1-4780-ab45-dde1641b83e3 could not be found. Jun 27 09:42:45.938673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:42:45.940085 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-99403573-6eb5-4e02-a3f3-df26b795ba56 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Returning 404 to user: Instance 3cb9074b-9ac1-4780-ab45-dde1641b83e3 could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:42:45.940085 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-99403573-6eb5-4e02-a3f3-df26b795ba56 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 404 len: 111 microversion: 2.1 time: 0.039375 Jun 27 09:42:45.940085 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 394/812] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:45 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 09:42:45.965338 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-ceae178a-d214-4768-8cfb-162162897cb9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:45.973342 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-ceae178a-d214-4768-8cfb-162162897cb9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:45.974851 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-ceae178a-d214-4768-8cfb-162162897cb9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:45.976121 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-ceae178a-d214-4768-8cfb-162162897cb9 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1730 microversion: 2.20 time: 0.181380 Jun 27 09:42:45.976679 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 419/813] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:45 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:46.039867 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e867de68-6a54-4272-b269-6ceb147dff5e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-144420057", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-205470936", "security_groups": [{"name": "tempest-secgroup-smoke-1479690552"}], "block_device_mapping_v2": [{"uuid": "644288a6-968a-4a7d-ac5e-f147505fad3e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "55f28e02-5cc3-4eaa-863b-67aabfa62103"}]}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:42:46.154912 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.network.neutron [None req-e867de68-6a54-4272-b269-6ceb147dff5e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] validate_networks() for [('55f28e02-5cc3-4eaa-863b-67aabfa62103', None, None, None, None, None)] {{(pid=124870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 09:42:46.241422 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-4352b4d2-3479-4ceb-8595-6b7ca11d6587 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:46.242307 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-4352b4d2-3479-4ceb-8595-6b7ca11d6587 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:46.249105 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4352b4d2-3479-4ceb-8595-6b7ca11d6587 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:46.249839 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4352b4d2-3479-4ceb-8595-6b7ca11d6587 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:46.250614 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4352b4d2-3479-4ceb-8595-6b7ca11d6587 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:46.251046 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4352b4d2-3479-4ceb-8595-6b7ca11d6587 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:46.388982 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4352b4d2-3479-4ceb-8595-6b7ca11d6587 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:46.396685 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-4352b4d2-3479-4ceb-8595-6b7ca11d6587 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 200 len: 1365 microversion: 2.1 time: 0.160393 Jun 27 09:42:46.398372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 420/814] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:46 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:42:46.533563 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-e867de68-6a54-4272-b269-6ceb147dff5e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Flavor limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 09:42:46.533995 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-e867de68-6a54-4272-b269-6ceb147dff5e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Image limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 09:42:46.534477 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-e867de68-6a54-4272-b269-6ceb147dff5e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Flavor pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 09:42:46.534899 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-e867de68-6a54-4272-b269-6ceb147dff5e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Image pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 09:42:46.535320 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-e867de68-6a54-4272-b269-6ceb147dff5e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 09:42:46.545147 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e867de68-6a54-4272-b269-6ceb147dff5e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:46.545595 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e867de68-6a54-4272-b269-6ceb147dff5e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:46.546400 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e867de68-6a54-4272-b269-6ceb147dff5e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:46.546839 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e867de68-6a54-4272-b269-6ceb147dff5e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:46.564044 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-e867de68-6a54-4272-b269-6ceb147dff5e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Getting quotas for project 1d5cbd080e204408aa51c29ec2cf1422. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:42:46.568001 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-e867de68-6a54-4272-b269-6ceb147dff5e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Getting quotas for user 2720d45854ab4a61b3b22dd43a523d4b and project 1d5cbd080e204408aa51c29ec2cf1422. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:42:46.624082 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e867de68-6a54-4272-b269-6ceb147dff5e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Going to run 1 instances... {{(pid=124870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 09:42:46.626213 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e867de68-6a54-4272-b269-6ceb147dff5e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='644288a6-968a-4a7d-ac5e-f147505fad3e',volume_size=None,volume_type=None)] {{(pid=124870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 09:42:46.994177 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-301ab6eb-0ab5-438a-9d69-c2d6a97209b7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:46.994876 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-301ab6eb-0ab5-438a-9d69-c2d6a97209b7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:47.001594 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-301ab6eb-0ab5-438a-9d69-c2d6a97209b7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:47.002129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-301ab6eb-0ab5-438a-9d69-c2d6a97209b7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:47.002981 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-301ab6eb-0ab5-438a-9d69-c2d6a97209b7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:47.003423 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-301ab6eb-0ab5-438a-9d69-c2d6a97209b7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:47.072749 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e867de68-6a54-4272-b269-6ceb147dff5e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.036717 Jun 27 09:42:47.078656 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 395/815] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 27 09:42:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 09:42:47.084310 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-4a575d71-814e-4d4b-986f-860f8141e02a tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:47.084440 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-4a575d71-814e-4d4b-986f-860f8141e02a tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:47.145476 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4a575d71-814e-4d4b-986f-860f8141e02a tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:47.153384 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-4a575d71-814e-4d4b-986f-860f8141e02a tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4" status: 200 len: 1093 microversion: 2.1 time: 0.073648 Jun 27 09:42:47.154714 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 396/816] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:47 2022] GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:42:47.174545 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-301ab6eb-0ab5-438a-9d69-c2d6a97209b7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:47.183384 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-301ab6eb-0ab5-438a-9d69-c2d6a97209b7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:47.185012 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-301ab6eb-0ab5-438a-9d69-c2d6a97209b7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:47.186256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-301ab6eb-0ab5-438a-9d69-c2d6a97209b7 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1730 microversion: 2.20 time: 0.196141 Jun 27 09:42:47.186893 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 421/817] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:46 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:47.414903 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-1bc46a24-6d98-49dd-a817-0e512ad9ac6c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:47.415767 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-1bc46a24-6d98-49dd-a817-0e512ad9ac6c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:47.424016 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1bc46a24-6d98-49dd-a817-0e512ad9ac6c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:47.424411 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1bc46a24-6d98-49dd-a817-0e512ad9ac6c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:47.425186 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1bc46a24-6d98-49dd-a817-0e512ad9ac6c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:47.425866 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1bc46a24-6d98-49dd-a817-0e512ad9ac6c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:47.436796 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-290ddfd9-1788-4ee7-bd60-72dfc6f774fc req-04088958-7af3-4f7c-805c-3a803bc18fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00cfa885-ac09-465b-a052-7ea258517d6d", "name": "network-vif-plugged", "status": "completed", "tag": "72ec9bf0-624a-42fd-8729-9acf6b562b8d"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:42:47.445110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-290ddfd9-1788-4ee7-bd60-72dfc6f774fc req-04088958-7af3-4f7c-805c-3a803bc18fb7 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:47.445555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-290ddfd9-1788-4ee7-bd60-72dfc6f774fc req-04088958-7af3-4f7c-805c-3a803bc18fb7 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:47.458286 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-290ddfd9-1788-4ee7-bd60-72dfc6f774fc req-04088958-7af3-4f7c-805c-3a803bc18fb7 service nova] Creating event network-vif-plugged:72ec9bf0-624a-42fd-8729-9acf6b562b8d for instance 00cfa885-ac09-465b-a052-7ea258517d6d on hv-cinder-84773 Jun 27 09:42:47.477796 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-290ddfd9-1788-4ee7-bd60-72dfc6f774fc req-04088958-7af3-4f7c-805c-3a803bc18fb7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045362 Jun 27 09:42:47.478403 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 422/818] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:42:47.581474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-1bc46a24-6d98-49dd-a817-0e512ad9ac6c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:47.594386 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-1bc46a24-6d98-49dd-a817-0e512ad9ac6c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 200 len: 1365 microversion: 2.1 time: 0.183832 Jun 27 09:42:47.595481 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 397/819] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:47 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:42:48.172534 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e751724a-cc8b-4064-b740-9ce51783aa9e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:48.173559 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-e751724a-cc8b-4064-b740-9ce51783aa9e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:48.181544 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e751724a-cc8b-4064-b740-9ce51783aa9e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:48.182577 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e751724a-cc8b-4064-b740-9ce51783aa9e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:48.183437 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e751724a-cc8b-4064-b740-9ce51783aa9e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:48.183906 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e751724a-cc8b-4064-b740-9ce51783aa9e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:48.206366 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-4738207d-cd66-41b7-b929-f1c7c3d9d19e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:48.207855 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-4738207d-cd66-41b7-b929-f1c7c3d9d19e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:48.214500 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4738207d-cd66-41b7-b929-f1c7c3d9d19e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:48.222664 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4738207d-cd66-41b7-b929-f1c7c3d9d19e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:48.222664 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4738207d-cd66-41b7-b929-f1c7c3d9d19e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:48.222664 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4738207d-cd66-41b7-b929-f1c7c3d9d19e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:48.255152 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e751724a-cc8b-4064-b740-9ce51783aa9e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:48.266791 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-e751724a-cc8b-4064-b740-9ce51783aa9e tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4" status: 200 len: 1143 microversion: 2.1 time: 0.099384 Jun 27 09:42:48.275723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 423/820] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:48 2022] GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 => generated 1143 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:48.351255 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4738207d-cd66-41b7-b929-f1c7c3d9d19e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:48.360024 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4738207d-cd66-41b7-b929-f1c7c3d9d19e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:48.361572 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4738207d-cd66-41b7-b929-f1c7c3d9d19e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:48.362725 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-4738207d-cd66-41b7-b929-f1c7c3d9d19e tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1730 microversion: 2.20 time: 0.161212 Jun 27 09:42:48.363286 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 398/821] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:48 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:48.620759 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-62aa9084-0024-45f3-852e-f912a48e03cb tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:48.622109 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-62aa9084-0024-45f3-852e-f912a48e03cb tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:48.628022 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-62aa9084-0024-45f3-852e-f912a48e03cb tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:48.628475 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-62aa9084-0024-45f3-852e-f912a48e03cb tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:48.629252 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-62aa9084-0024-45f3-852e-f912a48e03cb tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:48.629693 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-62aa9084-0024-45f3-852e-f912a48e03cb tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:48.766066 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-62aa9084-0024-45f3-852e-f912a48e03cb tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:48.773482 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-62aa9084-0024-45f3-852e-f912a48e03cb tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 200 len: 1365 microversion: 2.1 time: 0.165621 Jun 27 09:42:48.774039 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 424/822] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:48 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:49.284722 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-278b80f5-9106-4256-852f-7d2226fddcb7 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:49.286319 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-278b80f5-9106-4256-852f-7d2226fddcb7 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:49.296055 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-278b80f5-9106-4256-852f-7d2226fddcb7 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:49.297459 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-278b80f5-9106-4256-852f-7d2226fddcb7 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:49.297459 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-278b80f5-9106-4256-852f-7d2226fddcb7 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:49.297786 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-278b80f5-9106-4256-852f-7d2226fddcb7 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:49.359948 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-278b80f5-9106-4256-852f-7d2226fddcb7 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:49.368625 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-278b80f5-9106-4256-852f-7d2226fddcb7 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4" status: 200 len: 1191 microversion: 2.1 time: 0.088430 Jun 27 09:42:49.372283 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 399/823] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:49 2022] GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 => generated 1191 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:49.380658 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-283fe0d4-b8d5-4959-b351-5b948c57b663 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:49.381299 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-283fe0d4-b8d5-4959-b351-5b948c57b663 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:49.388457 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-283fe0d4-b8d5-4959-b351-5b948c57b663 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:49.388971 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-283fe0d4-b8d5-4959-b351-5b948c57b663 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:49.389678 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-283fe0d4-b8d5-4959-b351-5b948c57b663 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:49.390114 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-283fe0d4-b8d5-4959-b351-5b948c57b663 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:49.522040 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-283fe0d4-b8d5-4959-b351-5b948c57b663 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:49.530268 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-283fe0d4-b8d5-4959-b351-5b948c57b663 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:49.531651 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-283fe0d4-b8d5-4959-b351-5b948c57b663 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:49.532797 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-283fe0d4-b8d5-4959-b351-5b948c57b663 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1717 microversion: 2.20 time: 0.156001 Jun 27 09:42:49.533355 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 425/824] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:42:49 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1717 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:42:49.792392 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-d87d6fbe-9ba9-471b-9842-12e36a51d6d7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:49.793474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-d87d6fbe-9ba9-471b-9842-12e36a51d6d7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:49.800161 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d87d6fbe-9ba9-471b-9842-12e36a51d6d7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:49.800818 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d87d6fbe-9ba9-471b-9842-12e36a51d6d7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:49.801707 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d87d6fbe-9ba9-471b-9842-12e36a51d6d7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:49.802253 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d87d6fbe-9ba9-471b-9842-12e36a51d6d7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:49.940048 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d87d6fbe-9ba9-471b-9842-12e36a51d6d7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:49.947720 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-d87d6fbe-9ba9-471b-9842-12e36a51d6d7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 200 len: 1555 microversion: 2.1 time: 0.159658 Jun 27 09:42:49.951423 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 400/825] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:49 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:49.965128 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-a5364299-c313-4d73-8568-ab33ac3cc0c8 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:49.965774 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-a5364299-c313-4d73-8568-ab33ac3cc0c8 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:49.974835 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a5364299-c313-4d73-8568-ab33ac3cc0c8 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:49.975295 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a5364299-c313-4d73-8568-ab33ac3cc0c8 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:49.976202 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a5364299-c313-4d73-8568-ab33ac3cc0c8 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:49.976645 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a5364299-c313-4d73-8568-ab33ac3cc0c8 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:50.096858 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-a5364299-c313-4d73-8568-ab33ac3cc0c8 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136612 Jun 27 09:42:50.097480 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 426/826] 10.222.0.64 () {58 vars in 1274 bytes} [Mon Jun 27 09:42:49 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:42:50.387004 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-6a5f5286-78ac-44d4-bc4a-438ffb2dd68a tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:50.387935 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-6a5f5286-78ac-44d4-bc4a-438ffb2dd68a tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:50.394580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6a5f5286-78ac-44d4-bc4a-438ffb2dd68a tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:50.395359 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6a5f5286-78ac-44d4-bc4a-438ffb2dd68a tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:50.396360 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6a5f5286-78ac-44d4-bc4a-438ffb2dd68a tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:50.396869 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6a5f5286-78ac-44d4-bc4a-438ffb2dd68a tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:50.484872 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-6a5f5286-78ac-44d4-bc4a-438ffb2dd68a tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:50.496037 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-6a5f5286-78ac-44d4-bc4a-438ffb2dd68a tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4" status: 200 len: 1209 microversion: 2.1 time: 0.113535 Jun 27 09:42:50.496723 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 401/827] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:50 2022] GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 => generated 1209 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:51.188912 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-5dbc9a6a-5d02-4c16-9bb0-64bf2bf06c9e req-8305247e-adeb-42ee-b2a2-d500ebb3114e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00cfa885-ac09-465b-a052-7ea258517d6d", "tag": "72ec9bf0-624a-42fd-8729-9acf6b562b8d"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:42:51.196893 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-5dbc9a6a-5d02-4c16-9bb0-64bf2bf06c9e req-8305247e-adeb-42ee-b2a2-d500ebb3114e service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:51.197354 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-5dbc9a6a-5d02-4c16-9bb0-64bf2bf06c9e req-8305247e-adeb-42ee-b2a2-d500ebb3114e service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:51.208815 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-5dbc9a6a-5d02-4c16-9bb0-64bf2bf06c9e req-8305247e-adeb-42ee-b2a2-d500ebb3114e service nova] Creating event network-changed:72ec9bf0-624a-42fd-8729-9acf6b562b8d for instance 00cfa885-ac09-465b-a052-7ea258517d6d on hv-cinder-84773 Jun 27 09:42:51.214265 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-5dbc9a6a-5d02-4c16-9bb0-64bf2bf06c9e req-8305247e-adeb-42ee-b2a2-d500ebb3114e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029076 Jun 27 09:42:51.216108 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 427/828] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:42:51.517074 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-61deffb4-95c1-4ea7-83a8-ea7767277763 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:51.517519 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-61deffb4-95c1-4ea7-83a8-ea7767277763 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:51.525663 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-61deffb4-95c1-4ea7-83a8-ea7767277763 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:51.527357 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-61deffb4-95c1-4ea7-83a8-ea7767277763 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:51.529156 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-61deffb4-95c1-4ea7-83a8-ea7767277763 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:51.530095 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-61deffb4-95c1-4ea7-83a8-ea7767277763 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:51.788589 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-b565fa06-f353-4b08-a6ed-b55c1abced46 req-e046f0f6-7d1c-463c-8d01-1b03960592d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba58e72-a234-48f3-9163-461f3255f4b4", "tag": "ce6fb0fd-6c30-49fd-ba23-057daf263c03"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:42:51.825983 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-b565fa06-f353-4b08-a6ed-b55c1abced46 req-e046f0f6-7d1c-463c-8d01-1b03960592d0 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:51.826445 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-b565fa06-f353-4b08-a6ed-b55c1abced46 req-e046f0f6-7d1c-463c-8d01-1b03960592d0 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:51.833218 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-61deffb4-95c1-4ea7-83a8-ea7767277763 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:51.843114 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-b565fa06-f353-4b08-a6ed-b55c1abced46 req-e046f0f6-7d1c-463c-8d01-1b03960592d0 service nova] Creating event network-changed:ce6fb0fd-6c30-49fd-ba23-057daf263c03 for instance 7ba58e72-a234-48f3-9163-461f3255f4b4 on hv-cinder-84773 Jun 27 09:42:51.848929 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-61deffb4-95c1-4ea7-83a8-ea7767277763 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4" status: 200 len: 1265 microversion: 2.1 time: 0.336807 Jun 27 09:42:51.850146 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 402/829] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:51 2022] GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 => generated 1265 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:42:51.854310 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-b565fa06-f353-4b08-a6ed-b55c1abced46 req-e046f0f6-7d1c-463c-8d01-1b03960592d0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078797 Jun 27 09:42:51.855381 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 428/830] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:42:52.866929 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-0b429f3b-4dba-42f2-b634-fb1c8ce64ea8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:52.867559 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-0b429f3b-4dba-42f2-b634-fb1c8ce64ea8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:52.874136 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0b429f3b-4dba-42f2-b634-fb1c8ce64ea8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:52.874584 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0b429f3b-4dba-42f2-b634-fb1c8ce64ea8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:52.875348 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0b429f3b-4dba-42f2-b634-fb1c8ce64ea8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:52.875809 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0b429f3b-4dba-42f2-b634-fb1c8ce64ea8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:53.005093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-0b429f3b-4dba-42f2-b634-fb1c8ce64ea8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:53.013326 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-0b429f3b-4dba-42f2-b634-fb1c8ce64ea8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4" status: 200 len: 1265 microversion: 2.1 time: 0.150244 Jun 27 09:42:53.018031 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 403/831] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:52 2022] GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:42:54.031194 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-c6c8c643-81f5-4f77-bc6d-2ffdb7c1fe1c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:54.031949 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-c6c8c643-81f5-4f77-bc6d-2ffdb7c1fe1c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:54.038168 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c6c8c643-81f5-4f77-bc6d-2ffdb7c1fe1c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:54.038622 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c6c8c643-81f5-4f77-bc6d-2ffdb7c1fe1c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:54.039386 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c6c8c643-81f5-4f77-bc6d-2ffdb7c1fe1c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:54.039982 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c6c8c643-81f5-4f77-bc6d-2ffdb7c1fe1c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:54.171967 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-c6c8c643-81f5-4f77-bc6d-2ffdb7c1fe1c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:54.179700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-c6c8c643-81f5-4f77-bc6d-2ffdb7c1fe1c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4" status: 200 len: 1265 microversion: 2.1 time: 0.153054 Jun 27 09:42:54.180457 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 429/832] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:54 2022] GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:55.197098 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-0d3b3090-3bf1-4f1a-926c-6a065797409b tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:55.197703 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-0d3b3090-3bf1-4f1a-926c-6a065797409b tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:55.204920 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0d3b3090-3bf1-4f1a-926c-6a065797409b tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:55.205370 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0d3b3090-3bf1-4f1a-926c-6a065797409b tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:55.206133 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0d3b3090-3bf1-4f1a-926c-6a065797409b tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:55.206569 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0d3b3090-3bf1-4f1a-926c-6a065797409b tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:55.342590 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-0d3b3090-3bf1-4f1a-926c-6a065797409b tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:55.350053 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-0d3b3090-3bf1-4f1a-926c-6a065797409b tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4" status: 200 len: 1265 microversion: 2.1 time: 0.156898 Jun 27 09:42:55.350610 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 404/833] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:55 2022] GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:56.365757 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-8dc230c7-2a6c-4ab6-be92-2a4977af53a0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:56.366370 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-8dc230c7-2a6c-4ab6-be92-2a4977af53a0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:56.373010 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8dc230c7-2a6c-4ab6-be92-2a4977af53a0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:56.373511 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8dc230c7-2a6c-4ab6-be92-2a4977af53a0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:56.374375 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8dc230c7-2a6c-4ab6-be92-2a4977af53a0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:56.374800 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8dc230c7-2a6c-4ab6-be92-2a4977af53a0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:56.393252 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=100 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:56.507148 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-8dc230c7-2a6c-4ab6-be92-2a4977af53a0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:56.515564 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-8dc230c7-2a6c-4ab6-be92-2a4977af53a0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4" status: 200 len: 1265 microversion: 2.1 time: 0.153560 Jun 27 09:42:56.516198 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 430/834] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:56 2022] GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:57.532829 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-ea4590bf-b91e-4d8c-a01a-798984311253 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:57.533446 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-ea4590bf-b91e-4d8c-a01a-798984311253 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:57.535917 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=2 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:57.536589 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=8 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:42:57.542068 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ea4590bf-b91e-4d8c-a01a-798984311253 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:57.542526 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ea4590bf-b91e-4d8c-a01a-798984311253 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:57.543561 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ea4590bf-b91e-4d8c-a01a-798984311253 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:57.544005 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ea4590bf-b91e-4d8c-a01a-798984311253 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:57.677271 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-ea4590bf-b91e-4d8c-a01a-798984311253 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:57.685280 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-ea4590bf-b91e-4d8c-a01a-798984311253 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4" status: 200 len: 1265 microversion: 2.1 time: 0.156415 Jun 27 09:42:57.685923 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 405/835] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:57 2022] GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:58.702678 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-80e43f09-3964-4cea-9b49-e8c64a716c39 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:58.703297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-80e43f09-3964-4cea-9b49-e8c64a716c39 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:58.709867 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-80e43f09-3964-4cea-9b49-e8c64a716c39 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:58.710314 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-80e43f09-3964-4cea-9b49-e8c64a716c39 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:58.711080 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-80e43f09-3964-4cea-9b49-e8c64a716c39 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:58.711560 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-80e43f09-3964-4cea-9b49-e8c64a716c39 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:58.846364 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-80e43f09-3964-4cea-9b49-e8c64a716c39 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:42:58.854039 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-80e43f09-3964-4cea-9b49-e8c64a716c39 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4" status: 200 len: 1265 microversion: 2.1 time: 0.155259 Jun 27 09:42:58.854596 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 431/836] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:58 2022] GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:42:59.870669 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-dfa4f180-f561-4b50-93c7-cca02485008d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:42:59.871351 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-dfa4f180-f561-4b50-93c7-cca02485008d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:42:59.877428 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dfa4f180-f561-4b50-93c7-cca02485008d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:59.877874 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dfa4f180-f561-4b50-93c7-cca02485008d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:42:59.879224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dfa4f180-f561-4b50-93c7-cca02485008d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:42:59.879691 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dfa4f180-f561-4b50-93c7-cca02485008d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:00.013933 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-dfa4f180-f561-4b50-93c7-cca02485008d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:00.021482 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-dfa4f180-f561-4b50-93c7-cca02485008d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4" status: 200 len: 1265 microversion: 2.1 time: 0.155185 Jun 27 09:43:00.022041 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 406/837] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:42:59 2022] GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:43:01.038817 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-6133d55b-a34d-4f37-a2cd-bcaf5e769a89 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:01.039607 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-6133d55b-a34d-4f37-a2cd-bcaf5e769a89 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:01.046515 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6133d55b-a34d-4f37-a2cd-bcaf5e769a89 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:01.046972 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6133d55b-a34d-4f37-a2cd-bcaf5e769a89 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:01.047777 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6133d55b-a34d-4f37-a2cd-bcaf5e769a89 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:01.048216 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6133d55b-a34d-4f37-a2cd-bcaf5e769a89 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:01.185837 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6133d55b-a34d-4f37-a2cd-bcaf5e769a89 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:01.197839 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-6133d55b-a34d-4f37-a2cd-bcaf5e769a89 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4" status: 200 len: 1265 microversion: 2.1 time: 0.162863 Jun 27 09:43:01.198528 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 432/838] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:43:01 2022] GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:43:01.376464 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-4625aeaf-6c60-4304-ae2d-1dc1fcccc943 req-a87d2609-1e3a-4472-a301-3b7ca372c25a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba58e72-a234-48f3-9163-461f3255f4b4", "name": "network-vif-plugged", "status": "completed", "tag": "ce6fb0fd-6c30-49fd-ba23-057daf263c03"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:43:01.386244 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-4625aeaf-6c60-4304-ae2d-1dc1fcccc943 req-a87d2609-1e3a-4472-a301-3b7ca372c25a service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:01.386694 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-4625aeaf-6c60-4304-ae2d-1dc1fcccc943 req-a87d2609-1e3a-4472-a301-3b7ca372c25a service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:01.398090 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-4625aeaf-6c60-4304-ae2d-1dc1fcccc943 req-a87d2609-1e3a-4472-a301-3b7ca372c25a service nova] Creating event network-vif-plugged:ce6fb0fd-6c30-49fd-ba23-057daf263c03 for instance 7ba58e72-a234-48f3-9163-461f3255f4b4 on hv-cinder-84773 Jun 27 09:43:01.403485 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-4625aeaf-6c60-4304-ae2d-1dc1fcccc943 req-a87d2609-1e3a-4472-a301-3b7ca372c25a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031560 Jun 27 09:43:01.404132 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 407/839] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:43:02.214251 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-86391fe0-0381-414d-a910-05be00e371e6 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:02.214866 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-86391fe0-0381-414d-a910-05be00e371e6 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:02.221573 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-86391fe0-0381-414d-a910-05be00e371e6 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:02.222018 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-86391fe0-0381-414d-a910-05be00e371e6 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:02.222779 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-86391fe0-0381-414d-a910-05be00e371e6 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:02.223211 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-86391fe0-0381-414d-a910-05be00e371e6 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:02.373569 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-86391fe0-0381-414d-a910-05be00e371e6 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:02.381052 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-86391fe0-0381-414d-a910-05be00e371e6 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4" status: 200 len: 1265 microversion: 2.1 time: 0.170695 Jun 27 09:43:02.381618 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 433/840] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:43:02 2022] GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:43:03.399046 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-11226435-7e27-457c-98a6-d013c71788e5 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:03.399771 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-11226435-7e27-457c-98a6-d013c71788e5 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:03.406051 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-11226435-7e27-457c-98a6-d013c71788e5 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:03.406500 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-11226435-7e27-457c-98a6-d013c71788e5 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:03.407264 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-11226435-7e27-457c-98a6-d013c71788e5 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:03.407731 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-11226435-7e27-457c-98a6-d013c71788e5 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:03.542376 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-11226435-7e27-457c-98a6-d013c71788e5 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:03.550859 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-11226435-7e27-457c-98a6-d013c71788e5 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4" status: 200 len: 1265 microversion: 2.1 time: 0.156509 Jun 27 09:43:03.551437 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 408/841] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:43:03 2022] GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:43:04.568552 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-0bbf721e-2ac3-4976-9b5c-7e31faa73c7d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:04.569093 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-0bbf721e-2ac3-4976-9b5c-7e31faa73c7d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:04.575980 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0bbf721e-2ac3-4976-9b5c-7e31faa73c7d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:04.576424 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0bbf721e-2ac3-4976-9b5c-7e31faa73c7d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:04.577182 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0bbf721e-2ac3-4976-9b5c-7e31faa73c7d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:04.577611 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0bbf721e-2ac3-4976-9b5c-7e31faa73c7d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:04.719323 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-0bbf721e-2ac3-4976-9b5c-7e31faa73c7d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:04.726976 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-0bbf721e-2ac3-4976-9b5c-7e31faa73c7d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4" status: 200 len: 1451 microversion: 2.1 time: 0.162232 Jun 27 09:43:04.727560 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 434/842] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:43:04 2022] GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:43:04.742713 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-4efd567d-6084-4ca4-9cb1-efdb839ace11 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:04.743317 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-4efd567d-6084-4ca4-9cb1-efdb839ace11 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:04.749791 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4efd567d-6084-4ca4-9cb1-efdb839ace11 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:04.750240 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4efd567d-6084-4ca4-9cb1-efdb839ace11 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:04.751007 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4efd567d-6084-4ca4-9cb1-efdb839ace11 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:04.751445 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4efd567d-6084-4ca4-9cb1-efdb839ace11 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:04.886458 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4efd567d-6084-4ca4-9cb1-efdb839ace11 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:04.894032 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-4efd567d-6084-4ca4-9cb1-efdb839ace11 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4" status: 200 len: 1451 microversion: 2.1 time: 0.155095 Jun 27 09:43:04.894590 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 409/843] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:43:04 2022] GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:43:07.051994 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-3d152d0e-e9da-4cb4-a020-fd809fce633c req-472b399a-4640-4649-a2bf-afa1592928f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba58e72-a234-48f3-9163-461f3255f4b4", "tag": "ce6fb0fd-6c30-49fd-ba23-057daf263c03"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:43:07.055639 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=62 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:07.061687 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-3d152d0e-e9da-4cb4-a020-fd809fce633c req-472b399a-4640-4649-a2bf-afa1592928f7 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:07.062758 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-3d152d0e-e9da-4cb4-a020-fd809fce633c req-472b399a-4640-4649-a2bf-afa1592928f7 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:07.076168 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-3d152d0e-e9da-4cb4-a020-fd809fce633c req-472b399a-4640-4649-a2bf-afa1592928f7 service nova] Creating event network-changed:ce6fb0fd-6c30-49fd-ba23-057daf263c03 for instance 7ba58e72-a234-48f3-9163-461f3255f4b4 on hv-cinder-84773 Jun 27 09:43:07.082106 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-3d152d0e-e9da-4cb4-a020-fd809fce633c req-472b399a-4640-4649-a2bf-afa1592928f7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034787 Jun 27 09:43:07.083925 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 435/844] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:43:28.147989 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-73b47b17-81f2-4943-a3f1-1854bb273414 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:28.148946 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-73b47b17-81f2-4943-a3f1-1854bb273414 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:28.151597 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:28.152253 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=87 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:28.157686 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-73b47b17-81f2-4943-a3f1-1854bb273414 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:28.162871 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-73b47b17-81f2-4943-a3f1-1854bb273414 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:28.162871 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-73b47b17-81f2-4943-a3f1-1854bb273414 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:28.162871 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-73b47b17-81f2-4943-a3f1-1854bb273414 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:28.189107 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-73b47b17-81f2-4943-a3f1-1854bb273414 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045096 Jun 27 09:43:28.189660 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 410/845] 10.222.0.64 () {60 vars in 1342 bytes} [Mon Jun 27 09:43:28 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:43:28.246253 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=28 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:28.250589 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-76a9a98a-3782-495e-bcef-00bdaf44b32d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:28.251203 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-76a9a98a-3782-495e-bcef-00bdaf44b32d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:28.257568 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-76a9a98a-3782-495e-bcef-00bdaf44b32d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:28.258021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-76a9a98a-3782-495e-bcef-00bdaf44b32d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:28.258784 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-76a9a98a-3782-495e-bcef-00bdaf44b32d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:28.259245 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-76a9a98a-3782-495e-bcef-00bdaf44b32d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:28.286289 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-76a9a98a-3782-495e-bcef-00bdaf44b32d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Going to try to terminate instance {{(pid=124869) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 09:43:28.520775 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-76a9a98a-3782-495e-bcef-00bdaf44b32d tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "DELETE /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 204 len: 0 microversion: 2.20 time: 0.275875 Jun 27 09:43:28.521357 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 436/846] 10.222.0.64 () {60 vars in 1279 bytes} [Mon Jun 27 09:43:28 2022] DELETE /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 27 09:43:28.539692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-0febd8b1-bb7a-4f26-9235-99d59892c7f3 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:28.540331 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-0febd8b1-bb7a-4f26-9235-99d59892c7f3 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:28.547498 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0febd8b1-bb7a-4f26-9235-99d59892c7f3 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:28.547967 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0febd8b1-bb7a-4f26-9235-99d59892c7f3 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:28.548726 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0febd8b1-bb7a-4f26-9235-99d59892c7f3 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:28.549160 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0febd8b1-bb7a-4f26-9235-99d59892c7f3 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:28.678968 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-0febd8b1-bb7a-4f26-9235-99d59892c7f3 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:28.687269 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-0febd8b1-bb7a-4f26-9235-99d59892c7f3 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:28.688805 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-0febd8b1-bb7a-4f26-9235-99d59892c7f3 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:28.689942 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-0febd8b1-bb7a-4f26-9235-99d59892c7f3 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1723 microversion: 2.20 time: 0.154235 Jun 27 09:43:28.690502 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 411/847] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:43:28 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:43:29.091091 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-414f801a-35c3-486d-b547-6a91222c4817 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:29.091733 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-414f801a-35c3-486d-b547-6a91222c4817 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:29.097753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-414f801a-35c3-486d-b547-6a91222c4817 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:29.098206 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-414f801a-35c3-486d-b547-6a91222c4817 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:29.098970 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-414f801a-35c3-486d-b547-6a91222c4817 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:29.099410 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-414f801a-35c3-486d-b547-6a91222c4817 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:29.122645 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-414f801a-35c3-486d-b547-6a91222c4817 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d/ips" status: 200 len: 150 microversion: 2.1 time: 0.035977 Jun 27 09:43:29.124102 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 437/848] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jun 27 09:43:29 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:43:29.707591 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-4f3892f9-e302-400c-95c0-ccc2f07c5bd5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:29.708958 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-4f3892f9-e302-400c-95c0-ccc2f07c5bd5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:29.720422 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4f3892f9-e302-400c-95c0-ccc2f07c5bd5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:29.720422 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4f3892f9-e302-400c-95c0-ccc2f07c5bd5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:29.720422 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4f3892f9-e302-400c-95c0-ccc2f07c5bd5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:29.720422 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4f3892f9-e302-400c-95c0-ccc2f07c5bd5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:29.847865 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4f3892f9-e302-400c-95c0-ccc2f07c5bd5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:29.857263 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4f3892f9-e302-400c-95c0-ccc2f07c5bd5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:29.858844 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4f3892f9-e302-400c-95c0-ccc2f07c5bd5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:29.860102 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-4f3892f9-e302-400c-95c0-ccc2f07c5bd5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1723 microversion: 2.20 time: 0.156817 Jun 27 09:43:29.865708 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 412/849] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:43:29 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:43:30.826932 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-796b48fe-8b29-4063-a47d-253d4662158a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97974ba2-efb7-4711-88b6-6c3bf4a619ab"}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:43:30.828045 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-796b48fe-8b29-4063-a47d-253d4662158a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:30.834478 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-796b48fe-8b29-4063-a47d-253d4662158a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:30.834932 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-796b48fe-8b29-4063-a47d-253d4662158a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:30.835728 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-796b48fe-8b29-4063-a47d-253d4662158a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:30.836171 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-796b48fe-8b29-4063-a47d-253d4662158a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:30.878824 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-ffce1420-1ddb-4423-a5bc-c67ca37aa3ca tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:30.879718 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-ffce1420-1ddb-4423-a5bc-c67ca37aa3ca tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:30.886800 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ffce1420-1ddb-4423-a5bc-c67ca37aa3ca tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:30.887256 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ffce1420-1ddb-4423-a5bc-c67ca37aa3ca tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:30.888708 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ffce1420-1ddb-4423-a5bc-c67ca37aa3ca tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:30.889175 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ffce1420-1ddb-4423-a5bc-c67ca37aa3ca tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:30.998850 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-ffce1420-1ddb-4423-a5bc-c67ca37aa3ca tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:31.007236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-ffce1420-1ddb-4423-a5bc-c67ca37aa3ca tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:31.008883 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-ffce1420-1ddb-4423-a5bc-c67ca37aa3ca tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf085030e8e4a65a7140fea2b64a7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79203b0660c041f49c5f2629bd5a0bdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:31.010219 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-ffce1420-1ddb-4423-a5bc-c67ca37aa3ca tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 200 len: 1655 microversion: 2.20 time: 0.135122 Jun 27 09:43:31.015785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 413/850] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:43:30 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 1655 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 09:43:31.015785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-4a35fbe6-16ae-4c9f-9ca3-ff0a5535ac16 req-759db7c2-5acc-4f25-9385-6226a6271aff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "448074d1-f23d-4254-a9ec-26b00bd1298c", "name": "network-vif-deleted", "tag": "55e62be6-d365-40b9-9f9d-24357beba5b2"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:43:31.024929 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-4a35fbe6-16ae-4c9f-9ca3-ff0a5535ac16 req-759db7c2-5acc-4f25-9385-6226a6271aff service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:31.026093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-4a35fbe6-16ae-4c9f-9ca3-ff0a5535ac16 req-759db7c2-5acc-4f25-9385-6226a6271aff service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:31.039932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-4a35fbe6-16ae-4c9f-9ca3-ff0a5535ac16 req-759db7c2-5acc-4f25-9385-6226a6271aff service nova] Creating event network-vif-deleted:55e62be6-d365-40b9-9f9d-24357beba5b2 for instance 448074d1-f23d-4254-a9ec-26b00bd1298c on hv-cinder-84773 Jun 27 09:43:31.047327 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-4a35fbe6-16ae-4c9f-9ca3-ff0a5535ac16 req-759db7c2-5acc-4f25-9385-6226a6271aff service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035311 Jun 27 09:43:31.048921 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 414/851] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:43:31.622507 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-796b48fe-8b29-4063-a47d-253d4662158a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "POST /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.799428 Jun 27 09:43:31.623131 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 438/852] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 27 09:43:30 2022] POST /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d/os-volume_attachments => generated 194 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:43:32.029124 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-56f4b60c-d927-45d3-8850-6b28666ac631 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:32.029826 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-56f4b60c-d927-45d3-8850-6b28666ac631 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:32.037339 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-56f4b60c-d927-45d3-8850-6b28666ac631 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:32.038000 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-56f4b60c-d927-45d3-8850-6b28666ac631 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:32.038839 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-56f4b60c-d927-45d3-8850-6b28666ac631 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:32.039286 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-56f4b60c-d927-45d3-8850-6b28666ac631 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:32.054463 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-56f4b60c-d927-45d3-8850-6b28666ac631 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] HTTP exception thrown: Instance 448074d1-f23d-4254-a9ec-26b00bd1298c could not be found. Jun 27 09:43:32.056144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-56f4b60c-d927-45d3-8850-6b28666ac631 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Request method failure captured: Jun 27 09:43:32.056144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c HTTP/1.1 Jun 27 09:43:32.056144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:43:32.056144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:43:32.056144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:43:32.056144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:43:32.056144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:43:32.056144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:43:32.056144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:43:32.056144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:43:32.056144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXoJJ2on-vFvBN2hd8yLxFr4nVegprkoLqLkEWYwqvIslCEL7vsWnTBx7IO8PucStJDzd62-rrayKwqbZ1ocA321ZRnm_fBun99fzI6XjdKZFsSRzGUyPIn3uZ-BksjvZ0mRBGq4ePsoGmkGL3igk6m8swuGg-D3dqSjleQ3MXdBjHw Jun 27 09:43:32.056144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:43:32.056144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:43:32.056144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:43:32.056144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:43:32.056144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 09:43:32.056144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:43:32.056144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:43:32.056144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: 79203b0660c041f49c5f2629bd5a0bdf Jun 27 09:43:32.056144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-130800964 Jun 27 09:43:32.056144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:43:32.056144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:43:32.057681 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/79203b0660c041f49c5f2629bd5a0bdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/79203b0660c041f49c5f2629bd5a0bdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/79203b0660c041f49c5f2629bd5a0bdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_79203b0660c041f49c5f2629bd5a0bdf", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:43:32.057681 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-AttachVolumeShelveTestJSON-130800964 Jun 27 09:43:32.057681 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: 79203b0660c041f49c5f2629bd5a0bdf Jun 27 09:43:32.057681 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-130800964 Jun 27 09:43:32.057681 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-AttachVolumeShelveTestJSON-130800964-project Jun 27 09:43:32.057681 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:43:32.057681 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:43:32.057681 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: ecf085030e8e4a65a7140fea2b64a7ed Jun 27 09:43:32.057681 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-AttachVolumeShelveTestJSON-130800964-project Jun 27 09:43:32.057681 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: > Jun 27 09:43:32.057681 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Instance 448074d1-f23d-4254-a9ec-26b00bd1298c could not be found. Jun 27 09:43:32.057681 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': '448074d1-f23d-4254-a9ec-26b00bd1298c'} Jun 27 09:43:32.058469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:43:32.058469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:32.058469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:43:32.058469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:43:32.058469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:43:32.058469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:43:32.058469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:43:32.058469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:43:32.058469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:43:32.058469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:43:32.058469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 448074d1-f23d-4254-a9ec-26b00bd1298c could not be found. Jun 27 09:43:32.058469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:32.058469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:32.058469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:32.058469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:32.058469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:32.058469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:32.058469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:43:32.058469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:43:32.058469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:43:32.060090 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:43:32.060090 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:43:32.060090 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:43:32.060090 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:43:32.060090 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:43:32.060090 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:43:32.060090 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:43:32.060090 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 448074d1-f23d-4254-a9ec-26b00bd1298c could not be found. Jun 27 09:43:32.060090 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:32.060090 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:32.060090 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:32.060090 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:32.060090 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:32.060090 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:32.060090 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:43:32.060090 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:43:32.060090 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 448074d1-f23d-4254-a9ec-26b00bd1298c could not be found. Jun 27 09:43:32.060090 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:32.061947 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-56f4b60c-d927-45d3-8850-6b28666ac631 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Returning 404 to user: Instance 448074d1-f23d-4254-a9ec-26b00bd1298c could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:43:32.061947 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-56f4b60c-d927-45d3-8850-6b28666ac631 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 404 len: 111 microversion: 2.20 time: 0.032968 Jun 27 09:43:32.061947 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 415/853] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:43:32 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 09:43:32.068103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-d6544863-a279-43ff-906e-5fc8a040ab08 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '.version_select at 0x7ffa97280160>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:32.148469 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-d6544863-a279-43ff-906e-5fc8a040ab08 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2057933831" status: 204 len: 0 microversion: 2.20 time: 0.084542 Jun 27 09:43:32.149051 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 439/854] 10.222.0.64 () {60 vars in 1261 bytes} [Mon Jun 27 09:43:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2057933831 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 27 09:43:34.166061 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e135fee0-7e9e-44f7-9b87-5b44c3fa8eed tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:34.166545 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e135fee0-7e9e-44f7-9b87-5b44c3fa8eed tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:34.173955 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e135fee0-7e9e-44f7-9b87-5b44c3fa8eed tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:34.174402 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e135fee0-7e9e-44f7-9b87-5b44c3fa8eed tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:34.175162 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e135fee0-7e9e-44f7-9b87-5b44c3fa8eed tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:34.175632 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e135fee0-7e9e-44f7-9b87-5b44c3fa8eed tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:34.188728 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-e135fee0-7e9e-44f7-9b87-5b44c3fa8eed tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] HTTP exception thrown: Instance 448074d1-f23d-4254-a9ec-26b00bd1298c could not be found. Jun 27 09:43:34.190241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e135fee0-7e9e-44f7-9b87-5b44c3fa8eed tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Request method failure captured: Jun 27 09:43:34.190241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: DELETE /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c HTTP/1.1 Jun 27 09:43:34.190241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:43:34.190241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:43:34.190241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:43:34.190241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:43:34.190241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:43:34.190241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:43:34.190241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:43:34.190241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:43:34.190241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXoJJ2on-vFvBN2hd8yLxFr4nVegprkoLqLkEWYwqvIslCEL7vsWnTBx7IO8PucStJDzd62-rrayKwqbZ1ocA321ZRnm_fBun99fzI6XjdKZFsSRzGUyPIn3uZ-BksjvZ0mRBGq4ePsoGmkGL3igk6m8swuGg-D3dqSjleQ3MXdBjHw Jun 27 09:43:34.190241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:43:34.190241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:43:34.190241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:43:34.190241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:43:34.190241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 09:43:34.190241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:43:34.190241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:43:34.190241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: 79203b0660c041f49c5f2629bd5a0bdf Jun 27 09:43:34.190241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-130800964 Jun 27 09:43:34.190241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:43:34.190241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:43:34.191943 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/79203b0660c041f49c5f2629bd5a0bdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/79203b0660c041f49c5f2629bd5a0bdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/79203b0660c041f49c5f2629bd5a0bdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_79203b0660c041f49c5f2629bd5a0bdf", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:43:34.191943 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-AttachVolumeShelveTestJSON-130800964 Jun 27 09:43:34.191943 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: 79203b0660c041f49c5f2629bd5a0bdf Jun 27 09:43:34.191943 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-130800964 Jun 27 09:43:34.191943 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-AttachVolumeShelveTestJSON-130800964-project Jun 27 09:43:34.191943 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:43:34.191943 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:43:34.191943 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: ecf085030e8e4a65a7140fea2b64a7ed Jun 27 09:43:34.191943 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-AttachVolumeShelveTestJSON-130800964-project Jun 27 09:43:34.191943 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: > Jun 27 09:43:34.191943 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Instance 448074d1-f23d-4254-a9ec-26b00bd1298c could not be found. Jun 27 09:43:34.191943 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': '448074d1-f23d-4254-a9ec-26b00bd1298c'} Jun 27 09:43:34.192811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:43:34.192811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:34.192811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:43:34.192811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:43:34.192811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:43:34.192811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:43:34.192811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:43:34.192811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:43:34.192811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:43:34.192811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:43:34.192811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 448074d1-f23d-4254-a9ec-26b00bd1298c could not be found. Jun 27 09:43:34.192811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:34.192811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:34.192811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:34.192811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:34.192811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:34.192811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:34.192811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:43:34.192811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:43:34.192811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:43:34.194224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:43:34.194224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 09:43:34.194224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 09:43:34.194224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 09:43:34.194224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 09:43:34.194224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:43:34.194224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:43:34.194224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:43:34.194224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:43:34.194224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 448074d1-f23d-4254-a9ec-26b00bd1298c could not be found. Jun 27 09:43:34.194224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:34.194224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:34.194224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:34.194224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:34.194224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:34.194224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:34.194224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:43:34.194224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:43:34.194224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 448074d1-f23d-4254-a9ec-26b00bd1298c could not be found. Jun 27 09:43:34.194224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:34.195667 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e135fee0-7e9e-44f7-9b87-5b44c3fa8eed tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Returning 404 to user: Instance 448074d1-f23d-4254-a9ec-26b00bd1298c could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:43:34.195667 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e135fee0-7e9e-44f7-9b87-5b44c3fa8eed tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "DELETE /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 404 len: 111 microversion: 2.20 time: 0.029392 Jun 27 09:43:34.195667 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 416/855] 10.222.0.64 () {60 vars in 1279 bytes} [Mon Jun 27 09:43:34 2022] DELETE /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 09:43:34.200398 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-462e2cf3-59d9-43bc-b31c-68c7576b2ed5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:34.201219 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-462e2cf3-59d9-43bc-b31c-68c7576b2ed5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 448074d1-f23d-4254-a9ec-26b00bd1298c] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:34.207966 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-462e2cf3-59d9-43bc-b31c-68c7576b2ed5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:34.208412 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-462e2cf3-59d9-43bc-b31c-68c7576b2ed5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:34.209172 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-462e2cf3-59d9-43bc-b31c-68c7576b2ed5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:34.209608 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-462e2cf3-59d9-43bc-b31c-68c7576b2ed5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:34.222802 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-462e2cf3-59d9-43bc-b31c-68c7576b2ed5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] HTTP exception thrown: Instance 448074d1-f23d-4254-a9ec-26b00bd1298c could not be found. Jun 27 09:43:34.224418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-462e2cf3-59d9-43bc-b31c-68c7576b2ed5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Request method failure captured: Jun 27 09:43:34.224418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c HTTP/1.1 Jun 27 09:43:34.224418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:43:34.224418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:43:34.224418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:43:34.224418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:43:34.224418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:43:34.224418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:43:34.224418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:43:34.224418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:43:34.224418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXoJJ2on-vFvBN2hd8yLxFr4nVegprkoLqLkEWYwqvIslCEL7vsWnTBx7IO8PucStJDzd62-rrayKwqbZ1ocA321ZRnm_fBun99fzI6XjdKZFsSRzGUyPIn3uZ-BksjvZ0mRBGq4ePsoGmkGL3igk6m8swuGg-D3dqSjleQ3MXdBjHw Jun 27 09:43:34.224418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:43:34.224418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:43:34.224418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:43:34.224418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:43:34.224418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 09:43:34.224418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:43:34.224418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:43:34.224418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: 79203b0660c041f49c5f2629bd5a0bdf Jun 27 09:43:34.224418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-130800964 Jun 27 09:43:34.224418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:43:34.224418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:43:34.226095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/79203b0660c041f49c5f2629bd5a0bdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/79203b0660c041f49c5f2629bd5a0bdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/79203b0660c041f49c5f2629bd5a0bdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_79203b0660c041f49c5f2629bd5a0bdf", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:43:34.226095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-AttachVolumeShelveTestJSON-130800964 Jun 27 09:43:34.226095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: 79203b0660c041f49c5f2629bd5a0bdf Jun 27 09:43:34.226095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-130800964 Jun 27 09:43:34.226095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-AttachVolumeShelveTestJSON-130800964-project Jun 27 09:43:34.226095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:43:34.226095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:43:34.226095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: ecf085030e8e4a65a7140fea2b64a7ed Jun 27 09:43:34.226095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-AttachVolumeShelveTestJSON-130800964-project Jun 27 09:43:34.226095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: > Jun 27 09:43:34.226095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Instance 448074d1-f23d-4254-a9ec-26b00bd1298c could not be found. Jun 27 09:43:34.226095 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'id': '448074d1-f23d-4254-a9ec-26b00bd1298c'} Jun 27 09:43:34.226958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:43:34.226958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:34.226958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:43:34.226958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:43:34.226958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:43:34.226958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:43:34.226958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:43:34.226958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:43:34.226958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:43:34.226958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:43:34.226958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 448074d1-f23d-4254-a9ec-26b00bd1298c could not be found. Jun 27 09:43:34.226958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:34.226958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:34.226958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:34.226958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:34.226958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:34.226958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:34.226958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:43:34.226958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:43:34.226958 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:43:34.228447 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:43:34.228447 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:43:34.228447 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:43:34.228447 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:43:34.228447 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:43:34.228447 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:43:34.228447 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:43:34.228447 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 448074d1-f23d-4254-a9ec-26b00bd1298c could not be found. Jun 27 09:43:34.228447 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:34.228447 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:34.228447 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:34.228447 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:34.228447 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:34.228447 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:34.228447 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:43:34.228447 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:43:34.228447 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 448074d1-f23d-4254-a9ec-26b00bd1298c could not be found. Jun 27 09:43:34.228447 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:34.229702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-462e2cf3-59d9-43bc-b31c-68c7576b2ed5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Returning 404 to user: Instance 448074d1-f23d-4254-a9ec-26b00bd1298c could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:43:34.229702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-462e2cf3-59d9-43bc-b31c-68c7576b2ed5 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c" status: 404 len: 111 microversion: 2.20 time: 0.029741 Jun 27 09:43:34.229702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 440/856] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:43:34 2022] GET /compute/v2.1/servers/448074d1-f23d-4254-a9ec-26b00bd1298c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 09:43:35.488398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c4ba951f-08be-4d18-a5d1-f781f052a4b3 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:35.488917 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-c4ba951f-08be-4d18-a5d1-f781f052a4b3 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:35.495318 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c4ba951f-08be-4d18-a5d1-f781f052a4b3 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:35.495811 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c4ba951f-08be-4d18-a5d1-f781f052a4b3 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:35.496572 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c4ba951f-08be-4d18-a5d1-f781f052a4b3 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:35.497008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c4ba951f-08be-4d18-a5d1-f781f052a4b3 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:35.510109 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-c4ba951f-08be-4d18-a5d1-f781f052a4b3 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] HTTP exception thrown: Instance 1d72055f-6915-43b5-9831-61c2f134e60a could not be found. Jun 27 09:43:35.511649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c4ba951f-08be-4d18-a5d1-f781f052a4b3 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Request method failure captured: Jun 27 09:43:35.511649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: DELETE /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a HTTP/1.1 Jun 27 09:43:35.511649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:43:35.511649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:43:35.511649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:43:35.511649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:43:35.511649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:43:35.511649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:43:35.511649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:43:35.511649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:43:35.511649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXoJJ2on-vFvBN2hd8yLxFr4nVegprkoLqLkEWYwqvIslCEL7vsWnTBx7IO8PucStJDzd62-rrayKwqbZ1ocA321ZRnm_fBun99fzI6XjdKZFsSRzGUyPIn3uZ-BksjvZ0mRBGq4ePsoGmkGL3igk6m8swuGg-D3dqSjleQ3MXdBjHw Jun 27 09:43:35.511649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:43:35.511649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:43:35.511649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:43:35.511649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:43:35.511649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 09:43:35.511649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:43:35.511649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:43:35.511649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: 79203b0660c041f49c5f2629bd5a0bdf Jun 27 09:43:35.511649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-130800964 Jun 27 09:43:35.511649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:43:35.511649 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:43:35.513317 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/79203b0660c041f49c5f2629bd5a0bdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/79203b0660c041f49c5f2629bd5a0bdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/79203b0660c041f49c5f2629bd5a0bdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_79203b0660c041f49c5f2629bd5a0bdf", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:43:35.513317 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-AttachVolumeShelveTestJSON-130800964 Jun 27 09:43:35.513317 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: 79203b0660c041f49c5f2629bd5a0bdf Jun 27 09:43:35.513317 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-130800964 Jun 27 09:43:35.513317 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-AttachVolumeShelveTestJSON-130800964-project Jun 27 09:43:35.513317 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:43:35.513317 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:43:35.513317 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: ecf085030e8e4a65a7140fea2b64a7ed Jun 27 09:43:35.513317 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-AttachVolumeShelveTestJSON-130800964-project Jun 27 09:43:35.513317 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: > Jun 27 09:43:35.513317 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Instance 1d72055f-6915-43b5-9831-61c2f134e60a could not be found. Jun 27 09:43:35.513317 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': '1d72055f-6915-43b5-9831-61c2f134e60a'} Jun 27 09:43:35.514372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:43:35.514372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:35.514372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:43:35.514372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:43:35.514372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:43:35.514372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:43:35.514372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:43:35.514372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:43:35.514372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:43:35.514372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:43:35.514372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d72055f-6915-43b5-9831-61c2f134e60a could not be found. Jun 27 09:43:35.514372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:35.514372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:35.514372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:35.514372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:35.514372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:35.514372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:35.514372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:43:35.514372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:43:35.514372 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:43:35.515956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:43:35.515956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 09:43:35.515956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 09:43:35.515956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 09:43:35.515956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 09:43:35.515956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:43:35.515956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:43:35.515956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:43:35.515956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:43:35.515956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d72055f-6915-43b5-9831-61c2f134e60a could not be found. Jun 27 09:43:35.515956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:35.515956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:35.515956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:35.515956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:35.515956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:35.515956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:35.515956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:43:35.515956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:43:35.515956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d72055f-6915-43b5-9831-61c2f134e60a could not be found. Jun 27 09:43:35.515956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:35.517679 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c4ba951f-08be-4d18-a5d1-f781f052a4b3 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Returning 404 to user: Instance 1d72055f-6915-43b5-9831-61c2f134e60a could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:43:35.517679 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-c4ba951f-08be-4d18-a5d1-f781f052a4b3 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 404 len: 111 microversion: 2.20 time: 0.028449 Jun 27 09:43:35.517679 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 417/857] 10.222.0.64 () {60 vars in 1279 bytes} [Mon Jun 27 09:43:35 2022] DELETE /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 09:43:35.521145 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-7c813de3-d9c8-48ef-bd69-5d89f571e2d4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:35.521745 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-7c813de3-d9c8-48ef-bd69-5d89f571e2d4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] [instance: 1d72055f-6915-43b5-9831-61c2f134e60a] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:35.528174 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7c813de3-d9c8-48ef-bd69-5d89f571e2d4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:35.528566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7c813de3-d9c8-48ef-bd69-5d89f571e2d4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:35.529817 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7c813de3-d9c8-48ef-bd69-5d89f571e2d4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:35.530248 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7c813de3-d9c8-48ef-bd69-5d89f571e2d4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:35.543051 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-7c813de3-d9c8-48ef-bd69-5d89f571e2d4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] HTTP exception thrown: Instance 1d72055f-6915-43b5-9831-61c2f134e60a could not be found. Jun 27 09:43:35.545464 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-7c813de3-d9c8-48ef-bd69-5d89f571e2d4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Request method failure captured: Jun 27 09:43:35.545464 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a HTTP/1.1 Jun 27 09:43:35.545464 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:43:35.545464 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:43:35.545464 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:43:35.545464 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:43:35.545464 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:43:35.545464 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:43:35.545464 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:43:35.545464 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:43:35.545464 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXoJJ2on-vFvBN2hd8yLxFr4nVegprkoLqLkEWYwqvIslCEL7vsWnTBx7IO8PucStJDzd62-rrayKwqbZ1ocA321ZRnm_fBun99fzI6XjdKZFsSRzGUyPIn3uZ-BksjvZ0mRBGq4ePsoGmkGL3igk6m8swuGg-D3dqSjleQ3MXdBjHw Jun 27 09:43:35.545464 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:43:35.545464 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:43:35.545464 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:43:35.545464 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:43:35.545464 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 09:43:35.545464 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:43:35.545464 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:43:35.545464 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: 79203b0660c041f49c5f2629bd5a0bdf Jun 27 09:43:35.545464 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-130800964 Jun 27 09:43:35.545464 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:43:35.545464 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:43:35.547061 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/79203b0660c041f49c5f2629bd5a0bdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/79203b0660c041f49c5f2629bd5a0bdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/79203b0660c041f49c5f2629bd5a0bdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_79203b0660c041f49c5f2629bd5a0bdf", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:43:35.547061 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-AttachVolumeShelveTestJSON-130800964 Jun 27 09:43:35.547061 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: 79203b0660c041f49c5f2629bd5a0bdf Jun 27 09:43:35.547061 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-130800964 Jun 27 09:43:35.547061 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-AttachVolumeShelveTestJSON-130800964-project Jun 27 09:43:35.547061 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:43:35.547061 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:43:35.547061 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: ecf085030e8e4a65a7140fea2b64a7ed Jun 27 09:43:35.547061 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-AttachVolumeShelveTestJSON-130800964-project Jun 27 09:43:35.547061 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: > Jun 27 09:43:35.547061 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Instance 1d72055f-6915-43b5-9831-61c2f134e60a could not be found. Jun 27 09:43:35.547061 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'id': '1d72055f-6915-43b5-9831-61c2f134e60a'} Jun 27 09:43:35.547988 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:43:35.547988 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:35.547988 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:43:35.547988 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:43:35.547988 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:43:35.547988 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:43:35.547988 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:43:35.547988 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:43:35.547988 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:43:35.547988 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:43:35.547988 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d72055f-6915-43b5-9831-61c2f134e60a could not be found. Jun 27 09:43:35.547988 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:35.547988 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:35.547988 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:35.547988 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:35.547988 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:35.547988 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:35.547988 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:43:35.547988 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:43:35.547988 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:43:35.549189 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:43:35.549189 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:43:35.549189 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:43:35.549189 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:43:35.549189 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:43:35.549189 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:43:35.549189 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:43:35.549189 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d72055f-6915-43b5-9831-61c2f134e60a could not be found. Jun 27 09:43:35.549189 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:35.549189 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:35.549189 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:35.549189 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:35.549189 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:35.549189 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:35.549189 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:43:35.549189 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:43:35.549189 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d72055f-6915-43b5-9831-61c2f134e60a could not be found. Jun 27 09:43:35.549189 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:35.550264 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-7c813de3-d9c8-48ef-bd69-5d89f571e2d4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] Returning 404 to user: Instance 1d72055f-6915-43b5-9831-61c2f134e60a could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:43:35.550264 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-7c813de3-d9c8-48ef-bd69-5d89f571e2d4 tempest-AttachVolumeShelveTestJSON-130800964 tempest-AttachVolumeShelveTestJSON-130800964-project] 10.222.0.64 "GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a" status: 404 len: 111 microversion: 2.20 time: 0.029467 Jun 27 09:43:35.550264 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 441/858] 10.222.0.64 () {60 vars in 1276 bytes} [Mon Jun 27 09:43:35 2022] GET /compute/v2.1/servers/1d72055f-6915-43b5-9831-61c2f134e60a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 09:43:39.241086 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-93859747-857c-48e7-861e-11e236e58db5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:39.241677 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-93859747-857c-48e7-861e-11e236e58db5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:39.248265 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-93859747-857c-48e7-861e-11e236e58db5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:39.249248 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-93859747-857c-48e7-861e-11e236e58db5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:39.250007 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-93859747-857c-48e7-861e-11e236e58db5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:39.250445 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-93859747-857c-48e7-861e-11e236e58db5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:39.336517 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.objects.instance [None req-93859747-857c-48e7-861e-11e236e58db5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lazy-loading 'services' on Instance uuid 00cfa885-ac09-465b-a052-7ea258517d6d {{(pid=124870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:43:39.761530 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-93859747-857c-48e7-861e-11e236e58db5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "DELETE /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d/os-volume_attachments/97974ba2-efb7-4711-88b6-6c3bf4a619ab" status: 202 len: 0 microversion: 2.1 time: 0.520189 Jun 27 09:43:39.761530 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 418/859] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jun 27 09:43:39 2022] DELETE /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d/os-volume_attachments/97974ba2-efb7-4711-88b6-6c3bf4a619ab => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:43:39.767489 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-42263bb3-b44b-497c-917e-c5831fa8c56b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:39.769132 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-42263bb3-b44b-497c-917e-c5831fa8c56b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:39.776714 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-42263bb3-b44b-497c-917e-c5831fa8c56b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:39.776714 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-42263bb3-b44b-497c-917e-c5831fa8c56b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:39.777498 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-42263bb3-b44b-497c-917e-c5831fa8c56b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:39.778130 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-42263bb3-b44b-497c-917e-c5831fa8c56b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:39.809059 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-42263bb3-b44b-497c-917e-c5831fa8c56b tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045968 Jun 27 09:43:39.813770 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 442/860] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 27 09:43:39 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:43:40.822129 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c173ffff-c044-47fa-8629-cc1e7b3d55b7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:40.823202 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-c173ffff-c044-47fa-8629-cc1e7b3d55b7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:40.831295 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c173ffff-c044-47fa-8629-cc1e7b3d55b7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:40.832086 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c173ffff-c044-47fa-8629-cc1e7b3d55b7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:40.832868 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c173ffff-c044-47fa-8629-cc1e7b3d55b7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:40.833306 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c173ffff-c044-47fa-8629-cc1e7b3d55b7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:40.865566 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-c173ffff-c044-47fa-8629-cc1e7b3d55b7 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047713 Jun 27 09:43:40.866136 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 419/861] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 27 09:43:40 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 09:43:40.932892 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-4afca4b1-d5ae-4225-bf7e-8ddb7e01e9a6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:40.933418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-4afca4b1-d5ae-4225-bf7e-8ddb7e01e9a6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:40.940376 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4afca4b1-d5ae-4225-bf7e-8ddb7e01e9a6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:40.940823 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4afca4b1-d5ae-4225-bf7e-8ddb7e01e9a6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:40.941573 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4afca4b1-d5ae-4225-bf7e-8ddb7e01e9a6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:40.942032 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4afca4b1-d5ae-4225-bf7e-8ddb7e01e9a6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:40.967662 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-4afca4b1-d5ae-4225-bf7e-8ddb7e01e9a6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Going to try to terminate instance {{(pid=124869) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 09:43:41.241151 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-4afca4b1-d5ae-4225-bf7e-8ddb7e01e9a6 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "DELETE /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 204 len: 0 microversion: 2.1 time: 0.311780 Jun 27 09:43:41.241766 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 443/862] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:43:40 2022] DELETE /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 09:43:41.250430 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-2223434f-6b28-4ab5-b595-d349e2e26116 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:41.251048 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-2223434f-6b28-4ab5-b595-d349e2e26116 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:41.257129 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2223434f-6b28-4ab5-b595-d349e2e26116 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:41.257578 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2223434f-6b28-4ab5-b595-d349e2e26116 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:41.258348 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2223434f-6b28-4ab5-b595-d349e2e26116 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:41.258785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2223434f-6b28-4ab5-b595-d349e2e26116 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:41.435466 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-2223434f-6b28-4ab5-b595-d349e2e26116 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:41.450673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-2223434f-6b28-4ab5-b595-d349e2e26116 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 200 len: 1680 microversion: 2.1 time: 0.197122 Jun 27 09:43:41.450673 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 420/863] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:43:41 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 1680 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:43:42.460595 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e3c58c37-eed4-404b-a76c-ef404a270ce3 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:42.461291 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-e3c58c37-eed4-404b-a76c-ef404a270ce3 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:42.467892 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e3c58c37-eed4-404b-a76c-ef404a270ce3 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:42.468340 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e3c58c37-eed4-404b-a76c-ef404a270ce3 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:42.469234 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e3c58c37-eed4-404b-a76c-ef404a270ce3 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:42.469665 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e3c58c37-eed4-404b-a76c-ef404a270ce3 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:42.611904 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e3c58c37-eed4-404b-a76c-ef404a270ce3 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:42.620568 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-e3c58c37-eed4-404b-a76c-ef404a270ce3 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 200 len: 1680 microversion: 2.1 time: 0.164572 Jun 27 09:43:42.621477 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 444/864] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:43:42 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:43:43.638251 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-90dd73eb-4f0e-4496-a920-fd337cf334ff tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:43.639495 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-90dd73eb-4f0e-4496-a920-fd337cf334ff tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:43.646314 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-90dd73eb-4f0e-4496-a920-fd337cf334ff tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:43.646862 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-90dd73eb-4f0e-4496-a920-fd337cf334ff tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:43.647746 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-90dd73eb-4f0e-4496-a920-fd337cf334ff tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:43.648185 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-90dd73eb-4f0e-4496-a920-fd337cf334ff tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:43.963571 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-90dd73eb-4f0e-4496-a920-fd337cf334ff tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:43.972653 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-90dd73eb-4f0e-4496-a920-fd337cf334ff tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 200 len: 1680 microversion: 2.1 time: 0.338164 Jun 27 09:43:43.973591 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 421/865] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:43:43 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 1680 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:43:44.891943 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-23d6637e-cfbf-4181-9ea9-1f54ed713813 req-94c7410f-5ba6-4583-9b28-854ace54aa62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00cfa885-ac09-465b-a052-7ea258517d6d", "name": "network-vif-deleted", "tag": "72ec9bf0-624a-42fd-8729-9acf6b562b8d"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:43:44.902708 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-23d6637e-cfbf-4181-9ea9-1f54ed713813 req-94c7410f-5ba6-4583-9b28-854ace54aa62 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:44.903164 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-23d6637e-cfbf-4181-9ea9-1f54ed713813 req-94c7410f-5ba6-4583-9b28-854ace54aa62 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:44.916529 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-23d6637e-cfbf-4181-9ea9-1f54ed713813 req-94c7410f-5ba6-4583-9b28-854ace54aa62 service nova] Creating event network-vif-deleted:72ec9bf0-624a-42fd-8729-9acf6b562b8d for instance 00cfa885-ac09-465b-a052-7ea258517d6d on hv-cinder-84773 Jun 27 09:43:44.922845 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-23d6637e-cfbf-4181-9ea9-1f54ed713813 req-94c7410f-5ba6-4583-9b28-854ace54aa62 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040042 Jun 27 09:43:44.923975 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 445/866] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:43:44.990446 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-37fb797c-e782-4867-af14-afe6f3ebe9be tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:44.991445 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-37fb797c-e782-4867-af14-afe6f3ebe9be tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:44.998778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-37fb797c-e782-4867-af14-afe6f3ebe9be tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:44.999357 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-37fb797c-e782-4867-af14-afe6f3ebe9be tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:45.000260 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-37fb797c-e782-4867-af14-afe6f3ebe9be tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:45.000789 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-37fb797c-e782-4867-af14-afe6f3ebe9be tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:45.075103 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-37fb797c-e782-4867-af14-afe6f3ebe9be tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc8a087e97424d2890952be33695378f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b698ead017b4ef8b397ee127b487309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:45.085238 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-37fb797c-e782-4867-af14-afe6f3ebe9be tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 200 len: 1613 microversion: 2.1 time: 0.098608 Jun 27 09:43:45.087672 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 422/867] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:43:44 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 1613 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:43:46.105989 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-4d2c5db9-4056-40bb-8471-7943a9af9d1a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:46.106719 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-4d2c5db9-4056-40bb-8471-7943a9af9d1a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:46.115149 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4d2c5db9-4056-40bb-8471-7943a9af9d1a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:46.115867 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4d2c5db9-4056-40bb-8471-7943a9af9d1a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:46.116901 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4d2c5db9-4056-40bb-8471-7943a9af9d1a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:46.118224 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4d2c5db9-4056-40bb-8471-7943a9af9d1a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:46.139186 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-4d2c5db9-4056-40bb-8471-7943a9af9d1a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] HTTP exception thrown: Instance 00cfa885-ac09-465b-a052-7ea258517d6d could not be found. Jun 27 09:43:46.141267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-4d2c5db9-4056-40bb-8471-7943a9af9d1a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Request method failure captured: Jun 27 09:43:46.141267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d HTTP/1.1 Jun 27 09:43:46.141267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:43:46.141267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:43:46.141267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:43:46.141267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:43:46.141267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:43:46.141267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:43:46.141267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:43:46.141267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:43:46.141267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXpn-3iJO0jmG6cEr_seNLdcseHi8n8wEHckwmRo6ljOk7Dw2fW8MzVJsAVvtrRo6EbRwOL-ZWvD5H6s-lM4yKMyphFO-R0p3TN9KgYR5zUQQ4U5gMxDEUMuzuQRv_UTCVszqW1Rzxb7_cNEjM991nroZ5_Kz-paBsAlLj4MpU5gWgY Jun 27 09:43:46.141267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:43:46.141267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:43:46.141267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:43:46.141267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:43:46.141267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:43:46.141267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:43:46.141267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:43:46.141267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:46.141267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:43:46.141267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:43:46.142937 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4b698ead017b4ef8b397ee127b487309", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:43:46.142937 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:46.142937 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:43:46.142937 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:46.142937 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:43:46.142937 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:43:46.142937 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:43:46.142937 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: cc8a087e97424d2890952be33695378f Jun 27 09:43:46.142937 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:43:46.142937 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: > Jun 27 09:43:46.142937 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Instance 00cfa885-ac09-465b-a052-7ea258517d6d could not be found. Jun 27 09:43:46.142937 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'id': '00cfa885-ac09-465b-a052-7ea258517d6d'} Jun 27 09:43:46.143787 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:43:46.143787 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:46.143787 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:43:46.143787 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:43:46.143787 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:43:46.143787 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:43:46.143787 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:43:46.143787 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:43:46.143787 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:43:46.143787 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:43:46.143787 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00cfa885-ac09-465b-a052-7ea258517d6d could not be found. Jun 27 09:43:46.143787 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:46.143787 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:46.143787 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:46.143787 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:46.143787 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:46.143787 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:46.143787 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:43:46.143787 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:43:46.143787 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:43:46.145514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:43:46.145514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:43:46.145514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:43:46.145514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:43:46.145514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:43:46.145514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:43:46.145514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:43:46.145514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00cfa885-ac09-465b-a052-7ea258517d6d could not be found. Jun 27 09:43:46.145514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:46.145514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:46.145514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:46.145514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:46.145514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:46.145514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:46.145514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:43:46.145514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:43:46.145514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00cfa885-ac09-465b-a052-7ea258517d6d could not be found. Jun 27 09:43:46.145514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:46.148171 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-4d2c5db9-4056-40bb-8471-7943a9af9d1a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Returning 404 to user: Instance 00cfa885-ac09-465b-a052-7ea258517d6d could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:43:46.149368 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-4d2c5db9-4056-40bb-8471-7943a9af9d1a tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 404 len: 111 microversion: 2.1 time: 0.050066 Jun 27 09:43:46.150098 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 446/868] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:43:46 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:43:46.163316 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-16e78076-7b45-4730-93a8-06b5e0c53c9d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '.version_select at 0x7ffa97352af0>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:46.264529 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-16e78076-7b45-4730-93a8-06b5e0c53c9d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1099739914" status: 202 len: 0 microversion: 2.1 time: 0.108688 Jun 27 09:43:46.265113 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 423/869] 10.222.0.64 () {58 vars in 1220 bytes} [Mon Jun 27 09:43:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1099739914 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:43:47.688184 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-84f046f5-7193-4a07-b68c-6aca4aefa3d3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Action: 'create', calling method: .version_select at 0x7ffa9728d9d0>, body: {"keypair": {"name": "tempest-keypair-1633212746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcq15gtFJe3DC/yNh0yaWMrGYmv6ZMNsHqJqyYSBn/8Q30csmjxFkqsE1G8JWuBJlS0+N74JeJUSg5NiECQF39UTeAoJmB1QVfx/+ehRx/60galIOlNlfuJj48Mgrm48Q=="}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:43:47.702637 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-84f046f5-7193-4a07-b68c-6aca4aefa3d3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Getting quotas for project 422340b9e5834d16bff3539c549fc4c1. Resources: {'key_pairs'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:43:47.706971 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-84f046f5-7193-4a07-b68c-6aca4aefa3d3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Getting quotas for user 222b727863844d2b95a9c7222a56a94c and project 422340b9e5834d16bff3539c549fc4c1. Resources: {'key_pairs'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:43:47.800054 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-84f046f5-7193-4a07-b68c-6aca4aefa3d3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.232647 Jun 27 09:43:47.800662 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 447/870] 10.222.0.64 () {60 vars in 1158 bytes} [Mon Jun 27 09:43:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:43:48.492547 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-573a5105-3e58-4dd7-802d-9ecbbf8ae19f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:48.493129 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-573a5105-3e58-4dd7-802d-9ecbbf8ae19f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:48.500227 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-573a5105-3e58-4dd7-802d-9ecbbf8ae19f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:48.506002 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-573a5105-3e58-4dd7-802d-9ecbbf8ae19f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:48.506002 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-573a5105-3e58-4dd7-802d-9ecbbf8ae19f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:48.506002 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-573a5105-3e58-4dd7-802d-9ecbbf8ae19f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:48.515924 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-573a5105-3e58-4dd7-802d-9ecbbf8ae19f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] HTTP exception thrown: Instance 00cfa885-ac09-465b-a052-7ea258517d6d could not be found. Jun 27 09:43:48.517629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-573a5105-3e58-4dd7-802d-9ecbbf8ae19f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Request method failure captured: Jun 27 09:43:48.517629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: DELETE /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d HTTP/1.1 Jun 27 09:43:48.517629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:43:48.517629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:43:48.517629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:43:48.517629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:43:48.517629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:43:48.517629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:43:48.517629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:43:48.517629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:43:48.517629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXpn-3iJO0jmG6cEr_seNLdcseHi8n8wEHckwmRo6ljOk7Dw2fW8MzVJsAVvtrRo6EbRwOL-ZWvD5H6s-lM4yKMyphFO-R0p3TN9KgYR5zUQQ4U5gMxDEUMuzuQRv_UTCVszqW1Rzxb7_cNEjM991nroZ5_Kz-paBsAlLj4MpU5gWgY Jun 27 09:43:48.517629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:43:48.517629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:43:48.517629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:43:48.517629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:43:48.517629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:43:48.517629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:43:48.517629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:43:48.517629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:48.517629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:43:48.517629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:43:48.519277 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4b698ead017b4ef8b397ee127b487309", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:43:48.519277 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:48.519277 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:43:48.519277 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:48.519277 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:43:48.519277 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:43:48.519277 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:43:48.519277 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: cc8a087e97424d2890952be33695378f Jun 27 09:43:48.519277 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:43:48.519277 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: > Jun 27 09:43:48.519277 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Instance 00cfa885-ac09-465b-a052-7ea258517d6d could not be found. Jun 27 09:43:48.519277 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': '00cfa885-ac09-465b-a052-7ea258517d6d'} Jun 27 09:43:48.520229 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:43:48.520229 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:48.520229 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:43:48.520229 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:43:48.520229 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:43:48.520229 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:43:48.520229 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:43:48.520229 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:43:48.520229 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:43:48.520229 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:43:48.520229 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00cfa885-ac09-465b-a052-7ea258517d6d could not be found. Jun 27 09:43:48.520229 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:48.520229 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:48.520229 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:48.520229 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:48.520229 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:48.520229 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:48.520229 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:43:48.520229 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:43:48.520229 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:43:48.521675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:43:48.521675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 09:43:48.521675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 09:43:48.521675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 09:43:48.521675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 09:43:48.521675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:43:48.521675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:43:48.521675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:43:48.521675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:43:48.521675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00cfa885-ac09-465b-a052-7ea258517d6d could not be found. Jun 27 09:43:48.521675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:48.521675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:48.521675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:48.521675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:48.521675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:48.521675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:48.521675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:43:48.521675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:43:48.521675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00cfa885-ac09-465b-a052-7ea258517d6d could not be found. Jun 27 09:43:48.521675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:48.523160 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-573a5105-3e58-4dd7-802d-9ecbbf8ae19f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Returning 404 to user: Instance 00cfa885-ac09-465b-a052-7ea258517d6d could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:43:48.523160 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-573a5105-3e58-4dd7-802d-9ecbbf8ae19f tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "DELETE /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 404 len: 111 microversion: 2.1 time: 0.031543 Jun 27 09:43:48.523160 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 424/871] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:43:48 2022] DELETE /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:43:48.528472 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-d0a9f2a2-fc8c-4cc3-ae84-325b1a950519 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:48.529163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-d0a9f2a2-fc8c-4cc3-ae84-325b1a950519 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 00cfa885-ac09-465b-a052-7ea258517d6d] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:48.536262 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d0a9f2a2-fc8c-4cc3-ae84-325b1a950519 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:48.536830 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d0a9f2a2-fc8c-4cc3-ae84-325b1a950519 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:48.537836 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d0a9f2a2-fc8c-4cc3-ae84-325b1a950519 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:48.538329 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d0a9f2a2-fc8c-4cc3-ae84-325b1a950519 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:48.552556 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-d0a9f2a2-fc8c-4cc3-ae84-325b1a950519 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] HTTP exception thrown: Instance 00cfa885-ac09-465b-a052-7ea258517d6d could not be found. Jun 27 09:43:48.554205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-d0a9f2a2-fc8c-4cc3-ae84-325b1a950519 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Request method failure captured: Jun 27 09:43:48.554205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d HTTP/1.1 Jun 27 09:43:48.554205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:43:48.554205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:43:48.554205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:43:48.554205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:43:48.554205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:43:48.554205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:43:48.554205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:43:48.554205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:43:48.554205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXpn-3iJO0jmG6cEr_seNLdcseHi8n8wEHckwmRo6ljOk7Dw2fW8MzVJsAVvtrRo6EbRwOL-ZWvD5H6s-lM4yKMyphFO-R0p3TN9KgYR5zUQQ4U5gMxDEUMuzuQRv_UTCVszqW1Rzxb7_cNEjM991nroZ5_Kz-paBsAlLj4MpU5gWgY Jun 27 09:43:48.554205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:43:48.554205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:43:48.554205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:43:48.554205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:43:48.554205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:43:48.554205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:43:48.554205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:43:48.554205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:48.554205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:43:48.554205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:43:48.555860 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4b698ead017b4ef8b397ee127b487309", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:43:48.555860 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:48.555860 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:43:48.555860 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:48.555860 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:43:48.555860 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:43:48.555860 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:43:48.555860 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: cc8a087e97424d2890952be33695378f Jun 27 09:43:48.555860 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:43:48.555860 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: > Jun 27 09:43:48.555860 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Instance 00cfa885-ac09-465b-a052-7ea258517d6d could not be found. Jun 27 09:43:48.555860 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'id': '00cfa885-ac09-465b-a052-7ea258517d6d'} Jun 27 09:43:48.556768 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:43:48.556768 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:48.556768 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:43:48.556768 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:43:48.556768 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:43:48.556768 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:43:48.556768 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:43:48.556768 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:43:48.556768 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:43:48.556768 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:43:48.556768 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00cfa885-ac09-465b-a052-7ea258517d6d could not be found. Jun 27 09:43:48.556768 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:48.556768 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:48.556768 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:48.556768 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:48.556768 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:48.556768 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:48.556768 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:43:48.556768 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:43:48.556768 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:43:48.558244 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:43:48.558244 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:43:48.558244 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:43:48.558244 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:43:48.558244 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:43:48.558244 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:43:48.558244 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:43:48.558244 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00cfa885-ac09-465b-a052-7ea258517d6d could not be found. Jun 27 09:43:48.558244 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:48.558244 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:48.558244 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:48.558244 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:48.558244 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:48.558244 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:48.558244 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:43:48.558244 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:43:48.558244 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00cfa885-ac09-465b-a052-7ea258517d6d could not be found. Jun 27 09:43:48.558244 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:48.559554 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-d0a9f2a2-fc8c-4cc3-ae84-325b1a950519 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Returning 404 to user: Instance 00cfa885-ac09-465b-a052-7ea258517d6d could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:43:48.559554 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-d0a9f2a2-fc8c-4cc3-ae84-325b1a950519 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d" status: 404 len: 111 microversion: 2.1 time: 0.031455 Jun 27 09:43:48.560494 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 448/872] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:43:48 2022] GET /compute/v2.1/servers/00cfa885-ac09-465b-a052-7ea258517d6d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 09:43:49.854875 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-811376aa-3c24-4942-ae9b-9f8aef992084 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:49.855465 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-811376aa-3c24-4942-ae9b-9f8aef992084 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:49.862520 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-811376aa-3c24-4942-ae9b-9f8aef992084 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:49.862978 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-811376aa-3c24-4942-ae9b-9f8aef992084 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:49.863781 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-811376aa-3c24-4942-ae9b-9f8aef992084 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:49.864252 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-811376aa-3c24-4942-ae9b-9f8aef992084 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:49.879868 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-811376aa-3c24-4942-ae9b-9f8aef992084 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] HTTP exception thrown: Instance 70f57aa8-bd53-4836-97d8-44a90cfb3380 could not be found. Jun 27 09:43:49.884398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-811376aa-3c24-4942-ae9b-9f8aef992084 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Request method failure captured: Jun 27 09:43:49.884398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: DELETE /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380 HTTP/1.1 Jun 27 09:43:49.884398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:43:49.884398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:43:49.884398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:43:49.884398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:43:49.884398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:43:49.884398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:43:49.884398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:43:49.884398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:43:49.884398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXpn-3iJO0jmG6cEr_seNLdcseHi8n8wEHckwmRo6ljOk7Dw2fW8MzVJsAVvtrRo6EbRwOL-ZWvD5H6s-lM4yKMyphFO-R0p3TN9KgYR5zUQQ4U5gMxDEUMuzuQRv_UTCVszqW1Rzxb7_cNEjM991nroZ5_Kz-paBsAlLj4MpU5gWgY Jun 27 09:43:49.884398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:43:49.884398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:43:49.884398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:43:49.884398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:43:49.884398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:43:49.884398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:43:49.884398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:43:49.884398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:49.884398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:43:49.884398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:43:49.885721 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4b698ead017b4ef8b397ee127b487309", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:43:49.885721 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:49.885721 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:43:49.885721 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:49.885721 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:43:49.885721 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:43:49.885721 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:43:49.885721 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: cc8a087e97424d2890952be33695378f Jun 27 09:43:49.885721 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:43:49.885721 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: > Jun 27 09:43:49.885721 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Instance 70f57aa8-bd53-4836-97d8-44a90cfb3380 could not be found. Jun 27 09:43:49.885721 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': '70f57aa8-bd53-4836-97d8-44a90cfb3380'} Jun 27 09:43:49.886461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:43:49.886461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:49.886461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:43:49.886461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:43:49.886461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:43:49.886461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:43:49.886461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:43:49.886461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:43:49.886461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:43:49.886461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:43:49.886461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70f57aa8-bd53-4836-97d8-44a90cfb3380 could not be found. Jun 27 09:43:49.886461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:49.886461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:49.886461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:49.886461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:49.886461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:49.886461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:49.886461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:43:49.886461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:43:49.886461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:43:49.887817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:43:49.887817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 09:43:49.887817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 09:43:49.887817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 09:43:49.887817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 09:43:49.887817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:43:49.887817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:43:49.887817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:43:49.887817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:43:49.887817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70f57aa8-bd53-4836-97d8-44a90cfb3380 could not be found. Jun 27 09:43:49.887817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:49.887817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:49.887817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:49.887817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:49.887817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:49.887817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:49.887817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:43:49.887817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:43:49.887817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70f57aa8-bd53-4836-97d8-44a90cfb3380 could not be found. Jun 27 09:43:49.887817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:49.889657 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-811376aa-3c24-4942-ae9b-9f8aef992084 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Returning 404 to user: Instance 70f57aa8-bd53-4836-97d8-44a90cfb3380 could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:43:49.889657 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-811376aa-3c24-4942-ae9b-9f8aef992084 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "DELETE /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380" status: 404 len: 111 microversion: 2.1 time: 0.031830 Jun 27 09:43:49.889657 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 425/873] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:43:49 2022] DELETE /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:43:49.894406 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-3b4e6b47-a46b-4b10-9744-200defa8698c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:49.895151 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-3b4e6b47-a46b-4b10-9744-200defa8698c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 70f57aa8-bd53-4836-97d8-44a90cfb3380] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:49.901840 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3b4e6b47-a46b-4b10-9744-200defa8698c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:49.902454 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3b4e6b47-a46b-4b10-9744-200defa8698c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:49.903381 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3b4e6b47-a46b-4b10-9744-200defa8698c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:49.904140 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3b4e6b47-a46b-4b10-9744-200defa8698c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:49.919885 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-3b4e6b47-a46b-4b10-9744-200defa8698c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] HTTP exception thrown: Instance 70f57aa8-bd53-4836-97d8-44a90cfb3380 could not be found. Jun 27 09:43:49.921566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-3b4e6b47-a46b-4b10-9744-200defa8698c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Request method failure captured: Jun 27 09:43:49.921566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380 HTTP/1.1 Jun 27 09:43:49.921566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:43:49.921566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:43:49.921566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:43:49.921566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:43:49.921566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:43:49.921566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:43:49.921566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:43:49.921566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:43:49.921566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXpn-3iJO0jmG6cEr_seNLdcseHi8n8wEHckwmRo6ljOk7Dw2fW8MzVJsAVvtrRo6EbRwOL-ZWvD5H6s-lM4yKMyphFO-R0p3TN9KgYR5zUQQ4U5gMxDEUMuzuQRv_UTCVszqW1Rzxb7_cNEjM991nroZ5_Kz-paBsAlLj4MpU5gWgY Jun 27 09:43:49.921566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:43:49.921566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:43:49.921566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:43:49.921566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:43:49.921566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:43:49.921566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:43:49.921566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:43:49.921566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:49.921566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:43:49.921566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:43:49.923094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4b698ead017b4ef8b397ee127b487309", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:43:49.923094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:49.923094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:43:49.923094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:49.923094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:43:49.923094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:43:49.923094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:43:49.923094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: cc8a087e97424d2890952be33695378f Jun 27 09:43:49.923094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:43:49.923094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: > Jun 27 09:43:49.923094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Instance 70f57aa8-bd53-4836-97d8-44a90cfb3380 could not be found. Jun 27 09:43:49.923094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'id': '70f57aa8-bd53-4836-97d8-44a90cfb3380'} Jun 27 09:43:49.924327 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:43:49.924327 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:49.924327 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:43:49.924327 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:43:49.924327 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:43:49.924327 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:43:49.924327 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:43:49.924327 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:43:49.924327 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:43:49.924327 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:43:49.924327 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70f57aa8-bd53-4836-97d8-44a90cfb3380 could not be found. Jun 27 09:43:49.924327 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:49.924327 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:49.924327 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:49.924327 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:49.924327 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:49.924327 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:49.924327 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:43:49.924327 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:43:49.924327 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:43:49.925797 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:43:49.925797 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:43:49.925797 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:43:49.925797 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:43:49.925797 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:43:49.925797 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:43:49.925797 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:43:49.925797 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70f57aa8-bd53-4836-97d8-44a90cfb3380 could not be found. Jun 27 09:43:49.925797 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:49.925797 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:49.925797 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:49.925797 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:49.925797 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:49.925797 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:49.925797 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:43:49.925797 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:43:49.925797 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70f57aa8-bd53-4836-97d8-44a90cfb3380 could not be found. Jun 27 09:43:49.925797 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:49.927210 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-3b4e6b47-a46b-4b10-9744-200defa8698c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Returning 404 to user: Instance 70f57aa8-bd53-4836-97d8-44a90cfb3380 could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:43:49.927749 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-3b4e6b47-a46b-4b10-9744-200defa8698c tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380" status: 404 len: 111 microversion: 2.1 time: 0.040056 Jun 27 09:43:49.930226 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 449/874] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:43:49 2022] GET /compute/v2.1/servers/70f57aa8-bd53-4836-97d8-44a90cfb3380 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:43:49.936829 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-61a3998c-0348-470d-8c96-9db90960f5e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:49.937432 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-61a3998c-0348-470d-8c96-9db90960f5e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:49.943766 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-61a3998c-0348-470d-8c96-9db90960f5e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:49.944499 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-61a3998c-0348-470d-8c96-9db90960f5e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:49.945633 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-61a3998c-0348-470d-8c96-9db90960f5e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:49.946363 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-61a3998c-0348-470d-8c96-9db90960f5e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:49.961798 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-61a3998c-0348-470d-8c96-9db90960f5e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] HTTP exception thrown: Instance 102adf3a-476d-4af7-8267-15e963425bde could not be found. Jun 27 09:43:49.963932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-61a3998c-0348-470d-8c96-9db90960f5e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Request method failure captured: Jun 27 09:43:49.963932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: DELETE /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde HTTP/1.1 Jun 27 09:43:49.963932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:43:49.963932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:43:49.963932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:43:49.963932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:43:49.963932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:43:49.963932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:43:49.963932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:43:49.963932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:43:49.963932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXpn-3iJO0jmG6cEr_seNLdcseHi8n8wEHckwmRo6ljOk7Dw2fW8MzVJsAVvtrRo6EbRwOL-ZWvD5H6s-lM4yKMyphFO-R0p3TN9KgYR5zUQQ4U5gMxDEUMuzuQRv_UTCVszqW1Rzxb7_cNEjM991nroZ5_Kz-paBsAlLj4MpU5gWgY Jun 27 09:43:49.963932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:43:49.963932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:43:49.963932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:43:49.963932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:43:49.963932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:43:49.963932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:43:49.963932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:43:49.963932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:49.963932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:43:49.963932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:43:49.965526 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4b698ead017b4ef8b397ee127b487309", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:43:49.965526 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:49.965526 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:43:49.965526 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:49.965526 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:43:49.965526 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:43:49.965526 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:43:49.965526 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: cc8a087e97424d2890952be33695378f Jun 27 09:43:49.965526 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:43:49.965526 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: > Jun 27 09:43:49.965526 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Instance 102adf3a-476d-4af7-8267-15e963425bde could not be found. Jun 27 09:43:49.965526 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': '102adf3a-476d-4af7-8267-15e963425bde'} Jun 27 09:43:49.966611 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:43:49.966611 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:49.966611 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:43:49.966611 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:43:49.966611 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:43:49.966611 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:43:49.966611 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:43:49.966611 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:43:49.966611 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:43:49.966611 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:43:49.966611 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 102adf3a-476d-4af7-8267-15e963425bde could not be found. Jun 27 09:43:49.966611 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:49.966611 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:49.966611 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:49.966611 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:49.966611 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:49.966611 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:49.966611 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:43:49.966611 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:43:49.966611 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:43:49.968197 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:43:49.968197 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 09:43:49.968197 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 09:43:49.968197 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 09:43:49.968197 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 09:43:49.968197 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:43:49.968197 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:43:49.968197 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:43:49.968197 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:43:49.968197 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 102adf3a-476d-4af7-8267-15e963425bde could not be found. Jun 27 09:43:49.968197 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:49.968197 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:49.968197 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:49.968197 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:49.968197 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:49.968197 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:49.968197 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:43:49.968197 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:43:49.968197 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 102adf3a-476d-4af7-8267-15e963425bde could not be found. Jun 27 09:43:49.968197 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:49.969781 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-61a3998c-0348-470d-8c96-9db90960f5e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Returning 404 to user: Instance 102adf3a-476d-4af7-8267-15e963425bde could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:43:49.969781 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-61a3998c-0348-470d-8c96-9db90960f5e1 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "DELETE /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 404 len: 111 microversion: 2.1 time: 0.036013 Jun 27 09:43:49.970423 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 426/875] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:43:49 2022] DELETE /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:43:49.980245 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-82198c64-dd19-43c4-b146-92f30686056d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:49.980862 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-82198c64-dd19-43c4-b146-92f30686056d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 102adf3a-476d-4af7-8267-15e963425bde] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:49.989211 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-82198c64-dd19-43c4-b146-92f30686056d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:49.989664 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-82198c64-dd19-43c4-b146-92f30686056d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:49.990436 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-82198c64-dd19-43c4-b146-92f30686056d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:49.990867 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-82198c64-dd19-43c4-b146-92f30686056d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:50.005854 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-82198c64-dd19-43c4-b146-92f30686056d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] HTTP exception thrown: Instance 102adf3a-476d-4af7-8267-15e963425bde could not be found. Jun 27 09:43:50.009094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-82198c64-dd19-43c4-b146-92f30686056d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Request method failure captured: Jun 27 09:43:50.009094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde HTTP/1.1 Jun 27 09:43:50.009094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:43:50.009094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:43:50.009094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:43:50.009094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:43:50.009094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:43:50.009094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:43:50.009094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:43:50.009094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:43:50.009094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXpn-3iJO0jmG6cEr_seNLdcseHi8n8wEHckwmRo6ljOk7Dw2fW8MzVJsAVvtrRo6EbRwOL-ZWvD5H6s-lM4yKMyphFO-R0p3TN9KgYR5zUQQ4U5gMxDEUMuzuQRv_UTCVszqW1Rzxb7_cNEjM991nroZ5_Kz-paBsAlLj4MpU5gWgY Jun 27 09:43:50.009094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:43:50.009094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:43:50.009094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:43:50.009094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:43:50.009094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:43:50.009094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:43:50.009094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:43:50.009094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:50.009094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:43:50.009094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:43:50.014296 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4b698ead017b4ef8b397ee127b487309", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:43:50.014296 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:50.014296 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:43:50.014296 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:50.014296 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:43:50.014296 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:43:50.014296 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:43:50.014296 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: cc8a087e97424d2890952be33695378f Jun 27 09:43:50.014296 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:43:50.014296 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: > Jun 27 09:43:50.014296 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Instance 102adf3a-476d-4af7-8267-15e963425bde could not be found. Jun 27 09:43:50.014296 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'id': '102adf3a-476d-4af7-8267-15e963425bde'} Jun 27 09:43:50.015267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:43:50.015267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:50.015267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:43:50.015267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:43:50.015267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:43:50.015267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:43:50.015267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:43:50.015267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:43:50.015267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:43:50.015267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:43:50.015267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 102adf3a-476d-4af7-8267-15e963425bde could not be found. Jun 27 09:43:50.015267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:50.015267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:50.015267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:50.015267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:50.015267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:50.015267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:50.015267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:43:50.015267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:43:50.015267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:43:50.016772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:43:50.016772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:43:50.016772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:43:50.016772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:43:50.016772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:43:50.016772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:43:50.016772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:43:50.016772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 102adf3a-476d-4af7-8267-15e963425bde could not be found. Jun 27 09:43:50.016772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:50.016772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:50.016772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:50.016772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:50.016772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:50.016772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:50.016772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:43:50.016772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:43:50.016772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 102adf3a-476d-4af7-8267-15e963425bde could not be found. Jun 27 09:43:50.016772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:50.018239 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-82198c64-dd19-43c4-b146-92f30686056d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Returning 404 to user: Instance 102adf3a-476d-4af7-8267-15e963425bde could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:43:50.018239 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-82198c64-dd19-43c4-b146-92f30686056d tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde" status: 404 len: 111 microversion: 2.1 time: 0.034654 Jun 27 09:43:50.018239 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 450/876] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:43:49 2022] GET /compute/v2.1/servers/102adf3a-476d-4af7-8267-15e963425bde => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:43:50.147051 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-9de76234-aa29-4aa6-b157-4c15f43aa346 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-542025871", "imageRef": "96dfa32c-d52f-4225-8918-743ebc97f4bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63837ba7-06e7-4716-8f4c-6e58bcc433b2"}], "security_groups": [{"name": "tempest-securitygroup--1020445427"}], "key_name": "tempest-keypair-1633212746", "user_data": "}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:43:50.264068 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.network.neutron [None req-9de76234-aa29-4aa6-b157-4c15f43aa346 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] validate_networks() for [('63837ba7-06e7-4716-8f4c-6e58bcc433b2', None, None, None, None, None)] {{(pid=124870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 09:43:50.676756 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-9de76234-aa29-4aa6-b157-4c15f43aa346 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Flavor limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 09:43:50.677555 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-9de76234-aa29-4aa6-b157-4c15f43aa346 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Image limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 09:43:50.678260 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-9de76234-aa29-4aa6-b157-4c15f43aa346 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Flavor pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 09:43:50.678733 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-9de76234-aa29-4aa6-b157-4c15f43aa346 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Image pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 09:43:50.679180 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-9de76234-aa29-4aa6-b157-4c15f43aa346 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 09:43:50.690995 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9de76234-aa29-4aa6-b157-4c15f43aa346 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:50.691550 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9de76234-aa29-4aa6-b157-4c15f43aa346 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:50.692837 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9de76234-aa29-4aa6-b157-4c15f43aa346 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:50.693122 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9de76234-aa29-4aa6-b157-4c15f43aa346 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:50.710909 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-9de76234-aa29-4aa6-b157-4c15f43aa346 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Getting quotas for project 422340b9e5834d16bff3539c549fc4c1. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:43:50.715209 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-9de76234-aa29-4aa6-b157-4c15f43aa346 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Getting quotas for user 222b727863844d2b95a9c7222a56a94c and project 422340b9e5834d16bff3539c549fc4c1. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:43:50.727662 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-9de76234-aa29-4aa6-b157-4c15f43aa346 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Going to run 1 instances... {{(pid=124870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 09:43:50.729948 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-9de76234-aa29-4aa6-b157-4c15f43aa346 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96dfa32c-d52f-4225-8918-743ebc97f4bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 09:43:50.869442 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-9de76234-aa29-4aa6-b157-4c15f43aa346 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.726975 Jun 27 09:43:50.874736 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 427/877] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 27 09:43:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 09:43:50.880477 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-42ede0e0-f0d4-4ae3-8eda-d1cb8b6742e3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:50.881086 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-42ede0e0-f0d4-4ae3-8eda-d1cb8b6742e3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:50.943205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-42ede0e0-f0d4-4ae3-8eda-d1cb8b6742e3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:50.956042 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-42ede0e0-f0d4-4ae3-8eda-d1cb8b6742e3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1237 microversion: 2.1 time: 0.079273 Jun 27 09:43:50.956724 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 451/878] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:43:50 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1237 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:43:51.300405 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-0ef58cdc-f571-4e76-9d4a-589da31463a5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:51.301041 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-0ef58cdc-f571-4e76-9d4a-589da31463a5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:51.309814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0ef58cdc-f571-4e76-9d4a-589da31463a5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:51.310258 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0ef58cdc-f571-4e76-9d4a-589da31463a5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:51.311987 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0ef58cdc-f571-4e76-9d4a-589da31463a5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:51.312590 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0ef58cdc-f571-4e76-9d4a-589da31463a5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:51.326976 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-0ef58cdc-f571-4e76-9d4a-589da31463a5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] HTTP exception thrown: Instance 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 could not be found. Jun 27 09:43:51.328602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-0ef58cdc-f571-4e76-9d4a-589da31463a5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Request method failure captured: Jun 27 09:43:51.328602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: DELETE /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 HTTP/1.1 Jun 27 09:43:51.328602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:43:51.328602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:43:51.328602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:43:51.328602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:43:51.328602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:43:51.328602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:43:51.328602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:43:51.328602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:43:51.328602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXpn-3iJO0jmG6cEr_seNLdcseHi8n8wEHckwmRo6ljOk7Dw2fW8MzVJsAVvtrRo6EbRwOL-ZWvD5H6s-lM4yKMyphFO-R0p3TN9KgYR5zUQQ4U5gMxDEUMuzuQRv_UTCVszqW1Rzxb7_cNEjM991nroZ5_Kz-paBsAlLj4MpU5gWgY Jun 27 09:43:51.328602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:43:51.328602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:43:51.328602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:43:51.328602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:43:51.328602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:43:51.328602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:43:51.328602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:43:51.328602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:51.328602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:43:51.328602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:43:51.330215 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4b698ead017b4ef8b397ee127b487309", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:43:51.330215 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:51.330215 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:43:51.330215 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:51.330215 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:43:51.330215 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:43:51.330215 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:43:51.330215 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: cc8a087e97424d2890952be33695378f Jun 27 09:43:51.330215 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:43:51.330215 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: > Jun 27 09:43:51.330215 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Instance 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 could not be found. Jun 27 09:43:51.330215 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': '0dd479f3-f038-498f-b06d-c47cc1e8bfa2'} Jun 27 09:43:51.331157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:43:51.331157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:51.331157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:43:51.331157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:43:51.331157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:43:51.331157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:43:51.331157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:43:51.331157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:43:51.331157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:43:51.331157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:43:51.331157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 could not be found. Jun 27 09:43:51.331157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:51.331157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:51.331157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:51.331157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:51.331157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:51.331157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:51.331157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:43:51.331157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:43:51.331157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:43:51.332609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:43:51.332609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 09:43:51.332609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 09:43:51.332609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 09:43:51.332609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 09:43:51.332609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:43:51.332609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:43:51.332609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:43:51.332609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:43:51.332609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 could not be found. Jun 27 09:43:51.332609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:51.332609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:51.332609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:51.332609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:51.332609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:51.332609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:51.332609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:43:51.332609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:43:51.332609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 could not be found. Jun 27 09:43:51.332609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:43:51.333900 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-0ef58cdc-f571-4e76-9d4a-589da31463a5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Returning 404 to user: Instance 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:43:51.333900 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-0ef58cdc-f571-4e76-9d4a-589da31463a5 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 404 len: 111 microversion: 2.1 time: 0.033453 Jun 27 09:43:51.333900 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 428/879] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:43:51 2022] DELETE /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 09:43:51.338342 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-036f58d1-03c8-42a8-8b58-811cee4cd304 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:51.339002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-036f58d1-03c8-42a8-8b58-811cee4cd304 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] [instance: 0dd479f3-f038-498f-b06d-c47cc1e8bfa2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:51.348127 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-036f58d1-03c8-42a8-8b58-811cee4cd304 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:51.348127 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-036f58d1-03c8-42a8-8b58-811cee4cd304 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:51.348127 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-036f58d1-03c8-42a8-8b58-811cee4cd304 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:51.348127 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-036f58d1-03c8-42a8-8b58-811cee4cd304 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:51.360586 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-036f58d1-03c8-42a8-8b58-811cee4cd304 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] HTTP exception thrown: Instance 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 could not be found. Jun 27 09:43:51.362156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-036f58d1-03c8-42a8-8b58-811cee4cd304 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Request method failure captured: Jun 27 09:43:51.362156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 HTTP/1.1 Jun 27 09:43:51.362156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:43:51.362156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:43:51.362156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:43:51.362156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:43:51.362156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:43:51.362156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:43:51.362156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:43:51.362156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:43:51.362156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXpn-3iJO0jmG6cEr_seNLdcseHi8n8wEHckwmRo6ljOk7Dw2fW8MzVJsAVvtrRo6EbRwOL-ZWvD5H6s-lM4yKMyphFO-R0p3TN9KgYR5zUQQ4U5gMxDEUMuzuQRv_UTCVszqW1Rzxb7_cNEjM991nroZ5_Kz-paBsAlLj4MpU5gWgY Jun 27 09:43:51.362156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:43:51.362156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:43:51.362156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:43:51.362156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:43:51.362156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:43:51.362156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:43:51.362156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:43:51.362156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:51.362156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:43:51.362156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:43:51.363844 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4b698ead017b4ef8b397ee127b487309"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4b698ead017b4ef8b397ee127b487309", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:43:51.363844 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:51.363844 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: 4b698ead017b4ef8b397ee127b487309 Jun 27 09:43:51.363844 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1828249429 Jun 27 09:43:51.363844 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:43:51.363844 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:43:51.363844 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:43:51.363844 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: cc8a087e97424d2890952be33695378f Jun 27 09:43:51.363844 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-AttachVolumeNegativeTest-1828249429-project Jun 27 09:43:51.363844 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: > Jun 27 09:43:51.363844 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Instance 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 could not be found. Jun 27 09:43:51.363844 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'id': '0dd479f3-f038-498f-b06d-c47cc1e8bfa2'} Jun 27 09:43:51.364753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:43:51.364753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:51.364753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:43:51.364753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:43:51.364753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:43:51.364753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:43:51.364753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:43:51.364753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:43:51.364753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:43:51.364753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:43:51.364753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 could not be found. Jun 27 09:43:51.364753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:51.364753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:51.364753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:51.364753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:51.364753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:51.364753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:51.364753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:43:51.364753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:43:51.364753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:43:51.366254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:43:51.366254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:43:51.366254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:43:51.366254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:43:51.366254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:43:51.366254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:43:51.366254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:43:51.366254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 could not be found. Jun 27 09:43:51.366254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:51.366254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:43:51.366254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:51.366254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:43:51.366254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:43:51.366254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:43:51.366254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:43:51.366254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:43:51.366254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 could not be found. Jun 27 09:43:51.366254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:43:51.367661 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-036f58d1-03c8-42a8-8b58-811cee4cd304 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] Returning 404 to user: Instance 0dd479f3-f038-498f-b06d-c47cc1e8bfa2 could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:43:51.367661 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-036f58d1-03c8-42a8-8b58-811cee4cd304 tempest-AttachVolumeNegativeTest-1828249429 tempest-AttachVolumeNegativeTest-1828249429-project] 10.222.0.64 "GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2" status: 404 len: 111 microversion: 2.1 time: 0.029017 Jun 27 09:43:51.367661 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 452/880] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:43:51 2022] GET /compute/v2.1/servers/0dd479f3-f038-498f-b06d-c47cc1e8bfa2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:43:51.973450 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-20ed5578-f77b-4333-8869-fee1dad7cb60 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:51.974070 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-20ed5578-f77b-4333-8869-fee1dad7cb60 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:51.980840 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-20ed5578-f77b-4333-8869-fee1dad7cb60 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:51.981399 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-20ed5578-f77b-4333-8869-fee1dad7cb60 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:51.982169 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-20ed5578-f77b-4333-8869-fee1dad7cb60 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:51.983258 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-20ed5578-f77b-4333-8869-fee1dad7cb60 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:52.046298 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-20ed5578-f77b-4333-8869-fee1dad7cb60 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:52.053851 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-20ed5578-f77b-4333-8869-fee1dad7cb60 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1241 microversion: 2.1 time: 0.084339 Jun 27 09:43:52.054633 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 429/881] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:43:51 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:43:53.071698 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-b3ccae52-2640-4def-9916-2469493e503e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:53.072572 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-b3ccae52-2640-4def-9916-2469493e503e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:53.079793 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b3ccae52-2640-4def-9916-2469493e503e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:53.080846 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b3ccae52-2640-4def-9916-2469493e503e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:53.081921 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b3ccae52-2640-4def-9916-2469493e503e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:53.094868 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b3ccae52-2640-4def-9916-2469493e503e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:53.189451 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-b3ccae52-2640-4def-9916-2469493e503e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:53.198323 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-b3ccae52-2640-4def-9916-2469493e503e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1297 microversion: 2.1 time: 0.131013 Jun 27 09:43:53.209877 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 453/882] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:43:53 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1297 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:43:54.216858 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-bb0e133c-174f-4406-9aa4-c7b0e2a3970b tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:54.217478 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-bb0e133c-174f-4406-9aa4-c7b0e2a3970b tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:54.231455 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-bb0e133c-174f-4406-9aa4-c7b0e2a3970b tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:54.231942 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-bb0e133c-174f-4406-9aa4-c7b0e2a3970b tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:54.232745 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-bb0e133c-174f-4406-9aa4-c7b0e2a3970b tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:54.233192 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-bb0e133c-174f-4406-9aa4-c7b0e2a3970b tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:54.544571 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-bb0e133c-174f-4406-9aa4-c7b0e2a3970b tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:54.552437 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-bb0e133c-174f-4406-9aa4-c7b0e2a3970b tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1363 microversion: 2.1 time: 0.339590 Jun 27 09:43:54.556540 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 430/883] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:43:54 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1363 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:43:55.536371 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-64c8305c-f94e-4ca9-9d78-1a68da692b1a req-e3ad8ecb-b9dc-4ff2-b395-22769630c83b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "852e3cbc-67cd-4e86-b5ba-bdf54a75d114", "tag": "4b0d10bc-c18e-4f05-ade6-67243610a1f6"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:43:55.551117 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-64c8305c-f94e-4ca9-9d78-1a68da692b1a req-e3ad8ecb-b9dc-4ff2-b395-22769630c83b service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:55.551593 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-64c8305c-f94e-4ca9-9d78-1a68da692b1a req-e3ad8ecb-b9dc-4ff2-b395-22769630c83b service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:55.569576 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-64c8305c-f94e-4ca9-9d78-1a68da692b1a req-e3ad8ecb-b9dc-4ff2-b395-22769630c83b service nova] Creating event network-changed:4b0d10bc-c18e-4f05-ade6-67243610a1f6 for instance 852e3cbc-67cd-4e86-b5ba-bdf54a75d114 on hv-cinder-84773 Jun 27 09:43:55.570431 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c4beb9b2-19a5-4aa1-85a9-4bc7841fe720 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:55.572279 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-c4beb9b2-19a5-4aa1-85a9-4bc7841fe720 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:55.575223 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-64c8305c-f94e-4ca9-9d78-1a68da692b1a req-e3ad8ecb-b9dc-4ff2-b395-22769630c83b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042690 Jun 27 09:43:55.575829 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 454/884] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:43:55.580000 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c4beb9b2-19a5-4aa1-85a9-4bc7841fe720 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:55.580456 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c4beb9b2-19a5-4aa1-85a9-4bc7841fe720 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:55.581926 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c4beb9b2-19a5-4aa1-85a9-4bc7841fe720 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:55.582375 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c4beb9b2-19a5-4aa1-85a9-4bc7841fe720 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:55.815097 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-c4beb9b2-19a5-4aa1-85a9-4bc7841fe720 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:55.838806 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-c4beb9b2-19a5-4aa1-85a9-4bc7841fe720 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1363 microversion: 2.1 time: 0.270671 Jun 27 09:43:55.841085 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 431/885] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:43:55 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:43:56.856667 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-c2c1b856-d0c6-4b66-aa3c-bbe32b0f1b2a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:56.857368 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-c2c1b856-d0c6-4b66-aa3c-bbe32b0f1b2a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:56.864050 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c2c1b856-d0c6-4b66-aa3c-bbe32b0f1b2a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:56.864496 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c2c1b856-d0c6-4b66-aa3c-bbe32b0f1b2a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:56.865262 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c2c1b856-d0c6-4b66-aa3c-bbe32b0f1b2a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:56.865699 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c2c1b856-d0c6-4b66-aa3c-bbe32b0f1b2a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:56.998048 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-c2c1b856-d0c6-4b66-aa3c-bbe32b0f1b2a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:57.006070 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-c2c1b856-d0c6-4b66-aa3c-bbe32b0f1b2a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1363 microversion: 2.1 time: 0.154004 Jun 27 09:43:57.006624 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 455/886] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:43:56 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:43:58.021990 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-3b89b379-8a76-474f-9b69-d134734bae34 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:58.022599 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-3b89b379-8a76-474f-9b69-d134734bae34 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:58.029184 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3b89b379-8a76-474f-9b69-d134734bae34 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:58.029625 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3b89b379-8a76-474f-9b69-d134734bae34 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:58.030410 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3b89b379-8a76-474f-9b69-d134734bae34 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:58.030841 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3b89b379-8a76-474f-9b69-d134734bae34 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:58.164265 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-3b89b379-8a76-474f-9b69-d134734bae34 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:58.167847 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:58.172371 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-3b89b379-8a76-474f-9b69-d134734bae34 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1363 microversion: 2.1 time: 0.154210 Jun 27 09:43:58.172925 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 432/887] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:43:58 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:43:59.189083 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-c531a380-6148-4664-b7ca-65e3e5a0fed9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:43:59.189685 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-c531a380-6148-4664-b7ca-65e3e5a0fed9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:43:59.192330 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:59.197029 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c531a380-6148-4664-b7ca-65e3e5a0fed9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:59.197481 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c531a380-6148-4664-b7ca-65e3e5a0fed9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:59.199276 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c531a380-6148-4664-b7ca-65e3e5a0fed9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:43:59.199276 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c531a380-6148-4664-b7ca-65e3e5a0fed9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:43:59.206148 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:43:59.334198 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-c531a380-6148-4664-b7ca-65e3e5a0fed9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:43:59.342010 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-c531a380-6148-4664-b7ca-65e3e5a0fed9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1363 microversion: 2.1 time: 0.156830 Jun 27 09:43:59.342571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 456/888] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:43:59 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:00.360434 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-3e584ca1-4bbd-4572-8578-817f2ccc2678 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:00.361050 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-3e584ca1-4bbd-4572-8578-817f2ccc2678 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:00.363433 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:00.368685 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3e584ca1-4bbd-4572-8578-817f2ccc2678 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:00.369142 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3e584ca1-4bbd-4572-8578-817f2ccc2678 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:00.369916 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3e584ca1-4bbd-4572-8578-817f2ccc2678 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:00.370355 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3e584ca1-4bbd-4572-8578-817f2ccc2678 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:00.498533 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-3e584ca1-4bbd-4572-8578-817f2ccc2678 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:00.505997 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-3e584ca1-4bbd-4572-8578-817f2ccc2678 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1363 microversion: 2.1 time: 0.150538 Jun 27 09:44:00.506553 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 433/889] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:00 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:01.523795 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-8b2f972d-1828-43e5-87c4-3add09e01a97 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:01.524471 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-8b2f972d-1828-43e5-87c4-3add09e01a97 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:01.526729 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell0:SELECT=6 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:01.533380 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8b2f972d-1828-43e5-87c4-3add09e01a97 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:01.533835 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8b2f972d-1828-43e5-87c4-3add09e01a97 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:01.534615 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8b2f972d-1828-43e5-87c4-3add09e01a97 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:01.535237 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8b2f972d-1828-43e5-87c4-3add09e01a97 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:01.681207 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-8b2f972d-1828-43e5-87c4-3add09e01a97 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:01.686136 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-5dd84904-c552-488b-8f40-875720b53537 req-56571ea6-a3af-45a1-b50b-d10fdc654bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852e3cbc-67cd-4e86-b5ba-bdf54a75d114", "name": "network-vif-plugged", "status": "completed", "tag": "4b0d10bc-c18e-4f05-ade6-67243610a1f6"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:44:01.689927 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-8b2f972d-1828-43e5-87c4-3add09e01a97 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1363 microversion: 2.1 time: 0.170162 Jun 27 09:44:01.690089 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 457/890] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:01 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:44:01.698710 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=2 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:01.698710 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=6 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:01.698710 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-5dd84904-c552-488b-8f40-875720b53537 req-56571ea6-a3af-45a1-b50b-d10fdc654bfb service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:01.698710 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-5dd84904-c552-488b-8f40-875720b53537 req-56571ea6-a3af-45a1-b50b-d10fdc654bfb service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:01.708732 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-5dd84904-c552-488b-8f40-875720b53537 req-56571ea6-a3af-45a1-b50b-d10fdc654bfb service nova] Creating event network-vif-plugged:4b0d10bc-c18e-4f05-ade6-67243610a1f6 for instance 852e3cbc-67cd-4e86-b5ba-bdf54a75d114 on hv-cinder-84773 Jun 27 09:44:01.718857 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-5dd84904-c552-488b-8f40-875720b53537 req-56571ea6-a3af-45a1-b50b-d10fdc654bfb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031833 Jun 27 09:44:01.718857 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 434/891] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:44:02.707365 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-aae569e5-c05f-49c4-9717-f21d88640208 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:02.707939 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-aae569e5-c05f-49c4-9717-f21d88640208 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:02.714987 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-aae569e5-c05f-49c4-9717-f21d88640208 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:02.715443 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-aae569e5-c05f-49c4-9717-f21d88640208 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:02.716235 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-aae569e5-c05f-49c4-9717-f21d88640208 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:02.716675 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-aae569e5-c05f-49c4-9717-f21d88640208 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:02.842273 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-aae569e5-c05f-49c4-9717-f21d88640208 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:02.849775 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-aae569e5-c05f-49c4-9717-f21d88640208 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1363 microversion: 2.1 time: 0.146736 Jun 27 09:44:02.850605 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 458/892] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:02 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:03.869101 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-2bd4476b-d4d8-40b6-a454-fbbd2c5279fa tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:03.870090 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-2bd4476b-d4d8-40b6-a454-fbbd2c5279fa tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:03.878194 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2bd4476b-d4d8-40b6-a454-fbbd2c5279fa tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:03.878644 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2bd4476b-d4d8-40b6-a454-fbbd2c5279fa tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:03.879493 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2bd4476b-d4d8-40b6-a454-fbbd2c5279fa tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:03.879865 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2bd4476b-d4d8-40b6-a454-fbbd2c5279fa tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:04.019283 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-2bd4476b-d4d8-40b6-a454-fbbd2c5279fa tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:04.022783 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-2bd4476b-d4d8-40b6-a454-fbbd2c5279fa tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1550 microversion: 2.1 time: 0.159406 Jun 27 09:44:04.023348 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 435/893] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:03 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1550 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:04.043377 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-100d183c-1c00-4ee5-9f39-29e4d5f53599 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:04.044441 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-100d183c-1c00-4ee5-9f39-29e4d5f53599 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:04.052027 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-100d183c-1c00-4ee5-9f39-29e4d5f53599 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:04.052663 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-100d183c-1c00-4ee5-9f39-29e4d5f53599 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:04.053854 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-100d183c-1c00-4ee5-9f39-29e4d5f53599 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:04.054310 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-100d183c-1c00-4ee5-9f39-29e4d5f53599 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:04.132340 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-100d183c-1c00-4ee5-9f39-29e4d5f53599 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094344 Jun 27 09:44:04.133030 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 459/894] 10.222.0.64 () {58 vars in 1274 bytes} [Mon Jun 27 09:44:04 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:44:05.133471 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-1b4434b8-d2fb-4e27-9a8c-600d66bf87e2 req-ed291d06-d033-4fba-b29b-4ff6edadb4c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "852e3cbc-67cd-4e86-b5ba-bdf54a75d114", "tag": "4b0d10bc-c18e-4f05-ade6-67243610a1f6"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:44:05.142388 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-1b4434b8-d2fb-4e27-9a8c-600d66bf87e2 req-ed291d06-d033-4fba-b29b-4ff6edadb4c6 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:05.142906 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-1b4434b8-d2fb-4e27-9a8c-600d66bf87e2 req-ed291d06-d033-4fba-b29b-4ff6edadb4c6 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:05.153744 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-1b4434b8-d2fb-4e27-9a8c-600d66bf87e2 req-ed291d06-d033-4fba-b29b-4ff6edadb4c6 service nova] Creating event network-changed:4b0d10bc-c18e-4f05-ade6-67243610a1f6 for instance 852e3cbc-67cd-4e86-b5ba-bdf54a75d114 on hv-cinder-84773 Jun 27 09:44:05.159289 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-1b4434b8-d2fb-4e27-9a8c-600d66bf87e2 req-ed291d06-d033-4fba-b29b-4ff6edadb4c6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029458 Jun 27 09:44:05.159919 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 436/895] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:44:40.053757 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=7 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:40.054604 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=21 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:40.058504 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-db366eed-7291-4acb-b38f-c5e8f8735fa4 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2138818757", "imageRef": "96dfa32c-d52f-4225-8918-743ebc97f4bc", "flavorRef": "452", "networks": [{"uuid": "2c7da231-f63f-4eff-bafe-35d3dfbe40f5"}]}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:44:40.109415 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.network.neutron [None req-db366eed-7291-4acb-b38f-c5e8f8735fa4 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] validate_networks() for [('2c7da231-f63f-4eff-bafe-35d3dfbe40f5', None, None, None, None, None)] {{(pid=124869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 09:44:40.745246 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-db366eed-7291-4acb-b38f-c5e8f8735fa4 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Flavor limits 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 09:44:40.745705 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-db366eed-7291-4acb-b38f-c5e8f8735fa4 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Image limits 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 09:44:40.746182 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-db366eed-7291-4acb-b38f-c5e8f8735fa4 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Flavor pref 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 09:44:40.746595 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-db366eed-7291-4acb-b38f-c5e8f8735fa4 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Image pref 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 09:44:40.747011 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-db366eed-7291-4acb-b38f-c5e8f8735fa4 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 09:44:40.756007 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-db366eed-7291-4acb-b38f-c5e8f8735fa4 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:40.756456 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-db366eed-7291-4acb-b38f-c5e8f8735fa4 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:40.757254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-db366eed-7291-4acb-b38f-c5e8f8735fa4 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:40.757733 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-db366eed-7291-4acb-b38f-c5e8f8735fa4 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:40.774316 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-db366eed-7291-4acb-b38f-c5e8f8735fa4 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Getting quotas for project 428f2755baac4091a9d78e86090d819b. Resources: {'ram', 'instances', 'cores'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:44:40.778271 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-db366eed-7291-4acb-b38f-c5e8f8735fa4 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Getting quotas for user b432b13ffa7d42379fe38d6eed54e75f and project 428f2755baac4091a9d78e86090d819b. Resources: {'ram', 'instances', 'cores'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:44:40.789704 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-db366eed-7291-4acb-b38f-c5e8f8735fa4 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Going to run 1 instances... {{(pid=124869) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 09:44:40.791975 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-db366eed-7291-4acb-b38f-c5e8f8735fa4 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: cf63de97-74f7-4127-84ba-cceb6ff2d9d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96dfa32c-d52f-4225-8918-743ebc97f4bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 09:44:40.996218 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-db366eed-7291-4acb-b38f-c5e8f8735fa4 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.943902 Jun 27 09:44:40.996760 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 460/896] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 27 09:44:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 09:44:41.004526 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=7 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:41.005367 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=16 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:41.009441 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-68b1d9eb-806f-4d14-9a0f-52959f990da6 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:41.010219 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-68b1d9eb-806f-4d14-9a0f-52959f990da6 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: cf63de97-74f7-4127-84ba-cceb6ff2d9d3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:41.068009 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-68b1d9eb-806f-4d14-9a0f-52959f990da6 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:41.076621 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-68b1d9eb-806f-4d14-9a0f-52959f990da6 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3" status: 200 len: 1219 microversion: 2.1 time: 0.073489 Jun 27 09:44:41.077389 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 437/897] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:41 2022] GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3 => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:41.359727 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-6d25d67d-4700-45c7-93d5-7fbceb47fd45 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:41.360305 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-6d25d67d-4700-45c7-93d5-7fbceb47fd45 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:41.366846 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6d25d67d-4700-45c7-93d5-7fbceb47fd45 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:41.368975 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6d25d67d-4700-45c7-93d5-7fbceb47fd45 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:41.368975 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6d25d67d-4700-45c7-93d5-7fbceb47fd45 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:41.368975 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6d25d67d-4700-45c7-93d5-7fbceb47fd45 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:41.393938 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-6d25d67d-4700-45c7-93d5-7fbceb47fd45 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114/ips" status: 200 len: 147 microversion: 2.1 time: 0.038529 Jun 27 09:44:41.397732 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 461/898] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jun 27 09:44:41 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114/ips => generated 147 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:44:42.094874 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-7d507c97-17ce-45b7-a3d1-992971387454 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:42.095460 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-7d507c97-17ce-45b7-a3d1-992971387454 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: cf63de97-74f7-4127-84ba-cceb6ff2d9d3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:42.103141 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7d507c97-17ce-45b7-a3d1-992971387454 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:42.103631 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7d507c97-17ce-45b7-a3d1-992971387454 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:42.104419 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7d507c97-17ce-45b7-a3d1-992971387454 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:42.104858 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7d507c97-17ce-45b7-a3d1-992971387454 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:42.164865 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-7d507c97-17ce-45b7-a3d1-992971387454 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:42.173125 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-7d507c97-17ce-45b7-a3d1-992971387454 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3" status: 200 len: 1223 microversion: 2.1 time: 0.082757 Jun 27 09:44:42.173703 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 438/899] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:42 2022] GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:43.190325 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-92c00ded-7b3f-4462-99e6-94a94b7dec65 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:43.190941 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-92c00ded-7b3f-4462-99e6-94a94b7dec65 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: cf63de97-74f7-4127-84ba-cceb6ff2d9d3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:43.197402 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-92c00ded-7b3f-4462-99e6-94a94b7dec65 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:43.197856 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-92c00ded-7b3f-4462-99e6-94a94b7dec65 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:43.198614 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-92c00ded-7b3f-4462-99e6-94a94b7dec65 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:43.199053 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-92c00ded-7b3f-4462-99e6-94a94b7dec65 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:43.262099 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-92c00ded-7b3f-4462-99e6-94a94b7dec65 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:43.272051 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-92c00ded-7b3f-4462-99e6-94a94b7dec65 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3" status: 200 len: 1271 microversion: 2.1 time: 0.085815 Jun 27 09:44:43.281965 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 462/900] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:43 2022] GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3 => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:44.289183 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c4e97c51-5361-4222-a98e-8e4cf07e677b tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:44.290234 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-c4e97c51-5361-4222-a98e-8e4cf07e677b tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: cf63de97-74f7-4127-84ba-cceb6ff2d9d3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:44.297025 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c4e97c51-5361-4222-a98e-8e4cf07e677b tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:44.297474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c4e97c51-5361-4222-a98e-8e4cf07e677b tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:44.298382 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c4e97c51-5361-4222-a98e-8e4cf07e677b tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:44.298813 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c4e97c51-5361-4222-a98e-8e4cf07e677b tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:44.447828 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-c4e97c51-5361-4222-a98e-8e4cf07e677b tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:44.456238 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-c4e97c51-5361-4222-a98e-8e4cf07e677b tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3" status: 200 len: 1319 microversion: 2.1 time: 0.171047 Jun 27 09:44:44.466342 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 439/901] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:44 2022] GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:44.529061 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-18c156a8-3808-4b3f-81c2-41f6010f0810 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1909259015", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-205470936", "security_groups": [{"name": "tempest-secgroup-smoke-1479690552"}], "block_device_mapping_v2": [{"uuid": "e6cb6969-f42b-4d9b-8755-3f049a73b8c6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "55f28e02-5cc3-4eaa-863b-67aabfa62103"}]}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:44:44.641950 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.network.neutron [None req-18c156a8-3808-4b3f-81c2-41f6010f0810 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] validate_networks() for [('55f28e02-5cc3-4eaa-863b-67aabfa62103', None, None, None, None, None)] {{(pid=124869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 09:44:44.984131 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e6e82d85-387a-410f-96ae-bae5dc252bed tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b3c1245-6f43-4e30-a650-a45264f3b870"}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:44:44.985213 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e6e82d85-387a-410f-96ae-bae5dc252bed tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:44.991451 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e6e82d85-387a-410f-96ae-bae5dc252bed tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:44.998161 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e6e82d85-387a-410f-96ae-bae5dc252bed tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:44.998161 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e6e82d85-387a-410f-96ae-bae5dc252bed tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:44.998161 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e6e82d85-387a-410f-96ae-bae5dc252bed tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:45.017227 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-18c156a8-3808-4b3f-81c2-41f6010f0810 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Flavor limits 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 09:44:45.018404 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-18c156a8-3808-4b3f-81c2-41f6010f0810 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Image limits 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 09:44:45.019004 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-18c156a8-3808-4b3f-81c2-41f6010f0810 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Flavor pref 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 09:44:45.019517 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-18c156a8-3808-4b3f-81c2-41f6010f0810 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Image pref 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 09:44:45.019965 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-18c156a8-3808-4b3f-81c2-41f6010f0810 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 09:44:45.029585 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-18c156a8-3808-4b3f-81c2-41f6010f0810 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:45.030243 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-18c156a8-3808-4b3f-81c2-41f6010f0810 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:45.031056 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-18c156a8-3808-4b3f-81c2-41f6010f0810 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:45.032080 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-18c156a8-3808-4b3f-81c2-41f6010f0810 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:45.054970 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-18c156a8-3808-4b3f-81c2-41f6010f0810 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Getting quotas for project 1d5cbd080e204408aa51c29ec2cf1422. Resources: {'ram', 'instances', 'cores'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:44:45.054970 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-18c156a8-3808-4b3f-81c2-41f6010f0810 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Getting quotas for user 2720d45854ab4a61b3b22dd43a523d4b and project 1d5cbd080e204408aa51c29ec2cf1422. Resources: {'ram', 'instances', 'cores'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:44:45.112597 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-18c156a8-3808-4b3f-81c2-41f6010f0810 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Going to run 1 instances... {{(pid=124869) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 09:44:45.114673 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-18c156a8-3808-4b3f-81c2-41f6010f0810 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e6cb6969-f42b-4d9b-8755-3f049a73b8c6',volume_size=None,volume_type=None)] {{(pid=124869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 09:44:45.538909 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-18c156a8-3808-4b3f-81c2-41f6010f0810 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.013813 Jun 27 09:44:45.544779 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 463/902] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 27 09:44:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 09:44:45.550463 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-8ddad243-2f43-4fae-8cc7-babd12da65ba req-348789d2-44fc-4057-8ed1-c554431d2d12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf63de97-74f7-4127-84ba-cceb6ff2d9d3", "tag": "11c101a0-eea4-4619-85e4-b0a2c0919c37"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:44:45.559329 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-8ddad243-2f43-4fae-8cc7-babd12da65ba req-348789d2-44fc-4057-8ed1-c554431d2d12 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:45.560263 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-8ddad243-2f43-4fae-8cc7-babd12da65ba req-348789d2-44fc-4057-8ed1-c554431d2d12 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:45.571669 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-8ddad243-2f43-4fae-8cc7-babd12da65ba req-348789d2-44fc-4057-8ed1-c554431d2d12 service nova] Creating event network-changed:11c101a0-eea4-4619-85e4-b0a2c0919c37 for instance cf63de97-74f7-4127-84ba-cceb6ff2d9d3 on hv-cinder-84773 Jun 27 09:44:45.576723 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-8ddad243-2f43-4fae-8cc7-babd12da65ba req-348789d2-44fc-4057-8ed1-c554431d2d12 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030748 Jun 27 09:44:45.578969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 464/903] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:44:45.582293 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-deef211f-4389-451c-8f25-19621da4e4f3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:45.582990 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-deef211f-4389-451c-8f25-19621da4e4f3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: cf63de97-74f7-4127-84ba-cceb6ff2d9d3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:45.589360 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-deef211f-4389-451c-8f25-19621da4e4f3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:45.589813 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-deef211f-4389-451c-8f25-19621da4e4f3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:45.590580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-deef211f-4389-451c-8f25-19621da4e4f3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:45.591021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-deef211f-4389-451c-8f25-19621da4e4f3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:45.742822 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-deef211f-4389-451c-8f25-19621da4e4f3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:45.751124 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-deef211f-4389-451c-8f25-19621da4e4f3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3" status: 200 len: 1319 microversion: 2.1 time: 0.172690 Jun 27 09:44:45.751727 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 465/904] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:45 2022] GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:45.757236 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-2204e157-9cd1-4247-a630-005e77dc8567 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:45.757835 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-2204e157-9cd1-4247-a630-005e77dc8567 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:45.804906 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e6e82d85-387a-410f-96ae-bae5dc252bed tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "POST /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.824571 Jun 27 09:44:45.810009 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 440/905] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 27 09:44:44 2022] POST /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114/os-volume_attachments => generated 194 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:44:45.810296 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2204e157-9cd1-4247-a630-005e77dc8567 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:45.816719 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-2204e157-9cd1-4247-a630-005e77dc8567 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 200 len: 1094 microversion: 2.1 time: 0.063087 Jun 27 09:44:45.817276 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 466/906] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:45 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:46.768556 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-3a1ed840-8d4b-4f1e-8c18-e60fbd409d96 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:46.769610 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-3a1ed840-8d4b-4f1e-8c18-e60fbd409d96 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: cf63de97-74f7-4127-84ba-cceb6ff2d9d3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:46.776098 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3a1ed840-8d4b-4f1e-8c18-e60fbd409d96 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:46.776556 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3a1ed840-8d4b-4f1e-8c18-e60fbd409d96 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:46.777337 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3a1ed840-8d4b-4f1e-8c18-e60fbd409d96 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:46.777779 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3a1ed840-8d4b-4f1e-8c18-e60fbd409d96 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:46.834121 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-1e884839-9f8c-4580-9141-200a39d7f1be tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:46.834730 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-1e884839-9f8c-4580-9141-200a39d7f1be tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:46.842074 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1e884839-9f8c-4580-9141-200a39d7f1be tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:46.842520 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1e884839-9f8c-4580-9141-200a39d7f1be tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:46.843276 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1e884839-9f8c-4580-9141-200a39d7f1be tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:46.843989 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1e884839-9f8c-4580-9141-200a39d7f1be tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:46.922771 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-1e884839-9f8c-4580-9141-200a39d7f1be tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:46.934381 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-1e884839-9f8c-4580-9141-200a39d7f1be tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 200 len: 1144 microversion: 2.1 time: 0.103929 Jun 27 09:44:46.935899 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 467/907] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:46 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 1144 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:47.013766 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-3a1ed840-8d4b-4f1e-8c18-e60fbd409d96 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:47.021368 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-3a1ed840-8d4b-4f1e-8c18-e60fbd409d96 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3" status: 200 len: 1319 microversion: 2.1 time: 0.257780 Jun 27 09:44:47.022024 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 441/908] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:46 2022] GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:47.951968 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-196ff9b5-d091-453a-8b31-fe93836384a8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:47.952585 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-196ff9b5-d091-453a-8b31-fe93836384a8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:47.959456 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-196ff9b5-d091-453a-8b31-fe93836384a8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:47.965821 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-196ff9b5-d091-453a-8b31-fe93836384a8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:47.965821 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-196ff9b5-d091-453a-8b31-fe93836384a8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:47.965821 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-196ff9b5-d091-453a-8b31-fe93836384a8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:48.024806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-196ff9b5-d091-453a-8b31-fe93836384a8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:48.032403 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-196ff9b5-d091-453a-8b31-fe93836384a8 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 200 len: 1200 microversion: 2.1 time: 0.084229 Jun 27 09:44:48.033364 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 468/909] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:47 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 1200 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:48.038320 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-75eb6f3e-abc7-4930-a16e-8c59af242838 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:48.039128 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-75eb6f3e-abc7-4930-a16e-8c59af242838 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: cf63de97-74f7-4127-84ba-cceb6ff2d9d3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:48.046145 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-75eb6f3e-abc7-4930-a16e-8c59af242838 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:48.046591 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-75eb6f3e-abc7-4930-a16e-8c59af242838 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:48.047354 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-75eb6f3e-abc7-4930-a16e-8c59af242838 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:48.047823 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-75eb6f3e-abc7-4930-a16e-8c59af242838 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:48.192771 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-75eb6f3e-abc7-4930-a16e-8c59af242838 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:48.200198 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-75eb6f3e-abc7-4930-a16e-8c59af242838 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3" status: 200 len: 1319 microversion: 2.1 time: 0.165865 Jun 27 09:44:48.200763 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 442/910] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:48 2022] GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:44:49.050515 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-0c30b19e-2896-476e-ae4a-581c34c56091 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:49.051163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-0c30b19e-2896-476e-ae4a-581c34c56091 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:49.058782 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0c30b19e-2896-476e-ae4a-581c34c56091 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:49.059239 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0c30b19e-2896-476e-ae4a-581c34c56091 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:49.060431 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0c30b19e-2896-476e-ae4a-581c34c56091 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:49.061049 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0c30b19e-2896-476e-ae4a-581c34c56091 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:49.209948 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-0c30b19e-2896-476e-ae4a-581c34c56091 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:49.217775 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c02526bb-ac53-46d2-a780-f35a4f78ce82 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:49.218496 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-0c30b19e-2896-476e-ae4a-581c34c56091 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 200 len: 1278 microversion: 2.1 time: 0.172927 Jun 27 09:44:49.218817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-c02526bb-ac53-46d2-a780-f35a4f78ce82 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: cf63de97-74f7-4127-84ba-cceb6ff2d9d3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:49.219490 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 469/911] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:49 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 1278 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:49.226468 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c02526bb-ac53-46d2-a780-f35a4f78ce82 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:49.227086 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c02526bb-ac53-46d2-a780-f35a4f78ce82 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:49.228013 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c02526bb-ac53-46d2-a780-f35a4f78ce82 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:49.228563 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c02526bb-ac53-46d2-a780-f35a4f78ce82 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:49.446395 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-c02526bb-ac53-46d2-a780-f35a4f78ce82 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:49.461700 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-c02526bb-ac53-46d2-a780-f35a4f78ce82 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3" status: 200 len: 1319 microversion: 2.1 time: 0.248005 Jun 27 09:44:49.464112 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 443/912] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:49 2022] GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:49.918652 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-d2d27d75-c745-44bf-933e-fa1ff17a73df req-d529d67d-bf61-4e5d-8ccc-e31ed060cf90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "123a29e5-2f67-47b9-a67e-f8f6c63da8d1", "tag": "22d0d7b0-5a8c-4419-bf0c-95ba06adce52"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:44:49.928928 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-d2d27d75-c745-44bf-933e-fa1ff17a73df req-d529d67d-bf61-4e5d-8ccc-e31ed060cf90 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:49.939669 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-d2d27d75-c745-44bf-933e-fa1ff17a73df req-d529d67d-bf61-4e5d-8ccc-e31ed060cf90 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:50.098899 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-d2d27d75-c745-44bf-933e-fa1ff17a73df req-d529d67d-bf61-4e5d-8ccc-e31ed060cf90 service nova] Creating event network-changed:22d0d7b0-5a8c-4419-bf0c-95ba06adce52 for instance 123a29e5-2f67-47b9-a67e-f8f6c63da8d1 on hv-cinder-84773 Jun 27 09:44:50.104504 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-d2d27d75-c745-44bf-933e-fa1ff17a73df req-d529d67d-bf61-4e5d-8ccc-e31ed060cf90 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189567 Jun 27 09:44:50.105668 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 470/913] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:44:50.236294 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-04bd8ab8-fa2b-4c96-b3ea-2e790cc45386 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:50.236938 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-04bd8ab8-fa2b-4c96-b3ea-2e790cc45386 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:50.243459 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-04bd8ab8-fa2b-4c96-b3ea-2e790cc45386 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:50.244170 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-04bd8ab8-fa2b-4c96-b3ea-2e790cc45386 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:50.244947 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-04bd8ab8-fa2b-4c96-b3ea-2e790cc45386 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:50.245379 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-04bd8ab8-fa2b-4c96-b3ea-2e790cc45386 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:50.471900 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-04bd8ab8-fa2b-4c96-b3ea-2e790cc45386 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:50.478743 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-3e6f6ce7-3eec-41e5-be05-1fbe0b72482b tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:50.479438 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-3e6f6ce7-3eec-41e5-be05-1fbe0b72482b tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: cf63de97-74f7-4127-84ba-cceb6ff2d9d3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:50.482794 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-04bd8ab8-fa2b-4c96-b3ea-2e790cc45386 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 200 len: 1278 microversion: 2.1 time: 0.250176 Jun 27 09:44:50.483597 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 444/914] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:50 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 1278 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:50.485646 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3e6f6ce7-3eec-41e5-be05-1fbe0b72482b tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:50.486090 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3e6f6ce7-3eec-41e5-be05-1fbe0b72482b tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:50.486856 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3e6f6ce7-3eec-41e5-be05-1fbe0b72482b tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:50.487296 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3e6f6ce7-3eec-41e5-be05-1fbe0b72482b tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:50.624270 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-3e6f6ce7-3eec-41e5-be05-1fbe0b72482b tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:50.632371 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-3e6f6ce7-3eec-41e5-be05-1fbe0b72482b tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3" status: 200 len: 1319 microversion: 2.1 time: 0.157906 Jun 27 09:44:50.637213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 471/915] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:50 2022] GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:44:51.500220 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-34348d7c-713a-4742-9f0d-954449b6e289 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:51.500861 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-34348d7c-713a-4742-9f0d-954449b6e289 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:51.502859 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=2 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:51.508088 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-34348d7c-713a-4742-9f0d-954449b6e289 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:51.508532 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-34348d7c-713a-4742-9f0d-954449b6e289 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:51.509287 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-34348d7c-713a-4742-9f0d-954449b6e289 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:51.509713 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-34348d7c-713a-4742-9f0d-954449b6e289 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:51.638431 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-34348d7c-713a-4742-9f0d-954449b6e289 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:51.646374 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-34348d7c-713a-4742-9f0d-954449b6e289 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 200 len: 1278 microversion: 2.1 time: 0.150187 Jun 27 09:44:51.646936 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 445/916] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:51 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 1278 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:51.649446 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-69c65a83-c732-4b39-abf4-2e7853cc2f91 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:51.650048 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-69c65a83-c732-4b39-abf4-2e7853cc2f91 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: cf63de97-74f7-4127-84ba-cceb6ff2d9d3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:51.656771 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-69c65a83-c732-4b39-abf4-2e7853cc2f91 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:51.657224 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-69c65a83-c732-4b39-abf4-2e7853cc2f91 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:51.658057 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-69c65a83-c732-4b39-abf4-2e7853cc2f91 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:51.658492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-69c65a83-c732-4b39-abf4-2e7853cc2f91 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:51.787455 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-69c65a83-c732-4b39-abf4-2e7853cc2f91 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:51.795385 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-69c65a83-c732-4b39-abf4-2e7853cc2f91 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3" status: 200 len: 1319 microversion: 2.1 time: 0.149691 Jun 27 09:44:51.795984 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 472/917] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:51 2022] GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:51.842524 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-f0c5296a-4788-40b9-89d1-c06eabade738 req-f253b1e3-7d43-4e83-9244-c40a165305e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf63de97-74f7-4127-84ba-cceb6ff2d9d3", "name": "network-vif-plugged", "status": "completed", "tag": "11c101a0-eea4-4619-85e4-b0a2c0919c37"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:44:51.850589 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-f0c5296a-4788-40b9-89d1-c06eabade738 req-f253b1e3-7d43-4e83-9244-c40a165305e3 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:51.851042 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-f0c5296a-4788-40b9-89d1-c06eabade738 req-f253b1e3-7d43-4e83-9244-c40a165305e3 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:51.861724 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-f0c5296a-4788-40b9-89d1-c06eabade738 req-f253b1e3-7d43-4e83-9244-c40a165305e3 service nova] Creating event network-vif-plugged:11c101a0-eea4-4619-85e4-b0a2c0919c37 for instance cf63de97-74f7-4127-84ba-cceb6ff2d9d3 on hv-cinder-84773 Jun 27 09:44:51.866820 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-f0c5296a-4788-40b9-89d1-c06eabade738 req-f253b1e3-7d43-4e83-9244-c40a165305e3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028096 Jun 27 09:44:51.867399 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 446/918] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:44:52.663444 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e52376a5-311b-44a9-98ed-928a7fa222f7 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:52.664097 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-e52376a5-311b-44a9-98ed-928a7fa222f7 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:52.670790 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e52376a5-311b-44a9-98ed-928a7fa222f7 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:52.671245 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e52376a5-311b-44a9-98ed-928a7fa222f7 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:52.672049 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e52376a5-311b-44a9-98ed-928a7fa222f7 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:52.672491 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e52376a5-311b-44a9-98ed-928a7fa222f7 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:52.798703 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e52376a5-311b-44a9-98ed-928a7fa222f7 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:52.806844 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-e52376a5-311b-44a9-98ed-928a7fa222f7 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 200 len: 1278 microversion: 2.1 time: 0.147696 Jun 27 09:44:52.807402 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 473/919] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:52 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 1278 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:52.812957 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-9f9e1ed0-5c1c-434c-b234-2dde596d3d29 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:52.813652 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-9f9e1ed0-5c1c-434c-b234-2dde596d3d29 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: cf63de97-74f7-4127-84ba-cceb6ff2d9d3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:52.820221 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9f9e1ed0-5c1c-434c-b234-2dde596d3d29 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:52.820662 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9f9e1ed0-5c1c-434c-b234-2dde596d3d29 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:52.821413 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9f9e1ed0-5c1c-434c-b234-2dde596d3d29 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:52.821872 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9f9e1ed0-5c1c-434c-b234-2dde596d3d29 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:52.950202 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-9f9e1ed0-5c1c-434c-b234-2dde596d3d29 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:52.958060 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-9f9e1ed0-5c1c-434c-b234-2dde596d3d29 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3" status: 200 len: 1319 microversion: 2.1 time: 0.149297 Jun 27 09:44:52.958622 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 447/920] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:52 2022] GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:44:53.823666 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-578f5ca8-944b-477a-a641-8a88c2c8040c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:53.824281 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-578f5ca8-944b-477a-a641-8a88c2c8040c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:53.830871 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-578f5ca8-944b-477a-a641-8a88c2c8040c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:53.831311 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-578f5ca8-944b-477a-a641-8a88c2c8040c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:53.832198 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-578f5ca8-944b-477a-a641-8a88c2c8040c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:53.832640 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-578f5ca8-944b-477a-a641-8a88c2c8040c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:53.970627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-578f5ca8-944b-477a-a641-8a88c2c8040c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:53.974645 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-520419da-a8e7-4e9b-9337-8f0ecd78db56 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:53.975253 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-520419da-a8e7-4e9b-9337-8f0ecd78db56 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: cf63de97-74f7-4127-84ba-cceb6ff2d9d3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:53.979130 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-578f5ca8-944b-477a-a641-8a88c2c8040c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 200 len: 1278 microversion: 2.1 time: 0.159397 Jun 27 09:44:53.979755 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 474/921] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:53 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:53.981638 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-520419da-a8e7-4e9b-9337-8f0ecd78db56 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:53.982086 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-520419da-a8e7-4e9b-9337-8f0ecd78db56 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:53.982848 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-520419da-a8e7-4e9b-9337-8f0ecd78db56 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:53.983276 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-520419da-a8e7-4e9b-9337-8f0ecd78db56 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:54.112725 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-520419da-a8e7-4e9b-9337-8f0ecd78db56 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:54.120688 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-520419da-a8e7-4e9b-9337-8f0ecd78db56 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3" status: 200 len: 1508 microversion: 2.1 time: 0.150411 Jun 27 09:44:54.122066 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 448/922] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:53 2022] GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:44:54.996560 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-b6c163a9-4dc0-47ae-af1e-a7c163a9394a tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:54.997223 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-b6c163a9-4dc0-47ae-af1e-a7c163a9394a tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:55.004266 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b6c163a9-4dc0-47ae-af1e-a7c163a9394a tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:55.004708 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b6c163a9-4dc0-47ae-af1e-a7c163a9394a tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:55.005532 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b6c163a9-4dc0-47ae-af1e-a7c163a9394a tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:55.005967 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b6c163a9-4dc0-47ae-af1e-a7c163a9394a tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:55.041237 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell0:SELECT=4 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:55.136963 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-b6c163a9-4dc0-47ae-af1e-a7c163a9394a tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:55.144356 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-b6c163a9-4dc0-47ae-af1e-a7c163a9394a tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 200 len: 1278 microversion: 2.1 time: 0.151623 Jun 27 09:44:55.144917 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 475/923] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:54 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:55.465550 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-37b2e987-2452-487b-ab72-fa76a2f54f33 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:44:55.472710 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-37b2e987-2452-487b-ab72-fa76a2f54f33 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:55.473168 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-37b2e987-2452-487b-ab72-fa76a2f54f33 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:55.537297 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-37b2e987-2452-487b-ab72-fa76a2f54f33 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Going to try to stop instance {{(pid=124870) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 27 09:44:55.915983 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-37b2e987-2452-487b-ab72-fa76a2f54f33 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "POST /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114/action" status: 202 len: 0 microversion: 2.1 time: 0.453907 Jun 27 09:44:55.920294 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 449/924] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 27 09:44:55 2022] POST /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:44:55.926914 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-40ee390e-acdd-456e-873d-92b2c5ff7913 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:55.927466 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-40ee390e-acdd-456e-873d-92b2c5ff7913 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:55.929397 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell0:SELECT=14 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:55.934194 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-40ee390e-acdd-456e-873d-92b2c5ff7913 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:55.934647 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-40ee390e-acdd-456e-873d-92b2c5ff7913 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:55.935421 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-40ee390e-acdd-456e-873d-92b2c5ff7913 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:55.935887 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-40ee390e-acdd-456e-873d-92b2c5ff7913 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:56.076668 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-40ee390e-acdd-456e-873d-92b2c5ff7913 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:56.084666 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-40ee390e-acdd-456e-873d-92b2c5ff7913 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1725 microversion: 2.1 time: 0.161646 Jun 27 09:44:56.085222 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 476/925] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:55 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:56.162488 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-7a4c15df-6b5b-4de7-80f0-85e42891f172 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:56.163180 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-7a4c15df-6b5b-4de7-80f0-85e42891f172 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:56.169705 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7a4c15df-6b5b-4de7-80f0-85e42891f172 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:56.170146 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7a4c15df-6b5b-4de7-80f0-85e42891f172 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:56.170899 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7a4c15df-6b5b-4de7-80f0-85e42891f172 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:56.171329 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7a4c15df-6b5b-4de7-80f0-85e42891f172 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:56.302137 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-7a4c15df-6b5b-4de7-80f0-85e42891f172 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:56.309456 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-7a4c15df-6b5b-4de7-80f0-85e42891f172 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 200 len: 1266 microversion: 2.1 time: 0.152287 Jun 27 09:44:56.309998 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 450/926] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:56 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:57.102643 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-d6ca1a5e-0e04-416d-ae3c-a7e41f1438b3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:57.103246 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-d6ca1a5e-0e04-416d-ae3c-a7e41f1438b3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:57.109805 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d6ca1a5e-0e04-416d-ae3c-a7e41f1438b3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:57.110250 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d6ca1a5e-0e04-416d-ae3c-a7e41f1438b3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:57.111077 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d6ca1a5e-0e04-416d-ae3c-a7e41f1438b3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:57.111507 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d6ca1a5e-0e04-416d-ae3c-a7e41f1438b3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:57.241441 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-d6ca1a5e-0e04-416d-ae3c-a7e41f1438b3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:57.249441 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-d6ca1a5e-0e04-416d-ae3c-a7e41f1438b3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1725 microversion: 2.1 time: 0.150765 Jun 27 09:44:57.249996 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 477/927] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:57 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:57.326092 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-b23f5861-2c22-41e3-9ebf-2cbc36da3417 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:57.326694 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-b23f5861-2c22-41e3-9ebf-2cbc36da3417 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:57.333554 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b23f5861-2c22-41e3-9ebf-2cbc36da3417 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:57.333999 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b23f5861-2c22-41e3-9ebf-2cbc36da3417 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:57.334746 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b23f5861-2c22-41e3-9ebf-2cbc36da3417 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:57.335178 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b23f5861-2c22-41e3-9ebf-2cbc36da3417 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:57.468613 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-b23f5861-2c22-41e3-9ebf-2cbc36da3417 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:57.476807 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-b23f5861-2c22-41e3-9ebf-2cbc36da3417 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 200 len: 1266 microversion: 2.1 time: 0.154519 Jun 27 09:44:57.477431 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 451/928] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:57 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:44:58.266825 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-69ab5aab-0a79-46d6-aab8-e267da29707c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:58.267365 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-69ab5aab-0a79-46d6-aab8-e267da29707c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:58.274391 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-69ab5aab-0a79-46d6-aab8-e267da29707c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:58.275211 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-69ab5aab-0a79-46d6-aab8-e267da29707c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:58.275600 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-69ab5aab-0a79-46d6-aab8-e267da29707c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:58.276034 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-69ab5aab-0a79-46d6-aab8-e267da29707c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:58.407711 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-69ab5aab-0a79-46d6-aab8-e267da29707c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:58.416443 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-69ab5aab-0a79-46d6-aab8-e267da29707c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1725 microversion: 2.1 time: 0.153560 Jun 27 09:44:58.416999 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 478/929] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:58 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:58.494149 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-2c37e4e3-d4b2-4777-9c8b-f2e286ae685b tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:58.494763 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-2c37e4e3-d4b2-4777-9c8b-f2e286ae685b tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:58.501246 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2c37e4e3-d4b2-4777-9c8b-f2e286ae685b tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:58.501700 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2c37e4e3-d4b2-4777-9c8b-f2e286ae685b tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:58.502461 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2c37e4e3-d4b2-4777-9c8b-f2e286ae685b tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:58.502902 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2c37e4e3-d4b2-4777-9c8b-f2e286ae685b tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:58.634485 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-2c37e4e3-d4b2-4777-9c8b-f2e286ae685b tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:58.638072 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:44:58.642362 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-2c37e4e3-d4b2-4777-9c8b-f2e286ae685b tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 200 len: 1266 microversion: 2.1 time: 0.152164 Jun 27 09:44:58.642914 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 452/930] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:58 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:44:59.435336 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e9c64311-b8e5-4ac3-8fef-46624029ecf8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:59.436093 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-e9c64311-b8e5-4ac3-8fef-46624029ecf8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:59.443598 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e9c64311-b8e5-4ac3-8fef-46624029ecf8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:59.444076 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e9c64311-b8e5-4ac3-8fef-46624029ecf8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:59.444889 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e9c64311-b8e5-4ac3-8fef-46624029ecf8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:59.445333 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e9c64311-b8e5-4ac3-8fef-46624029ecf8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:59.575246 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e9c64311-b8e5-4ac3-8fef-46624029ecf8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:59.583724 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-e9c64311-b8e5-4ac3-8fef-46624029ecf8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1725 microversion: 2.1 time: 0.152250 Jun 27 09:44:59.584283 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 479/931] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:59 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:44:59.660484 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e412d914-ff3a-40d4-9ead-c2bbde527b76 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:44:59.661090 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e412d914-ff3a-40d4-9ead-c2bbde527b76 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:44:59.668153 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e412d914-ff3a-40d4-9ead-c2bbde527b76 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:59.668645 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e412d914-ff3a-40d4-9ead-c2bbde527b76 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:59.669375 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e412d914-ff3a-40d4-9ead-c2bbde527b76 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:44:59.670057 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e412d914-ff3a-40d4-9ead-c2bbde527b76 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:44:59.800012 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-e412d914-ff3a-40d4-9ead-c2bbde527b76 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:44:59.807344 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e412d914-ff3a-40d4-9ead-c2bbde527b76 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 200 len: 1266 microversion: 2.1 time: 0.151426 Jun 27 09:44:59.807937 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 453/932] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:44:59 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:00.600318 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-edb489df-cf59-4a8b-9e89-f615d6e2a8e8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:00.600857 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-edb489df-cf59-4a8b-9e89-f615d6e2a8e8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:00.607271 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-edb489df-cf59-4a8b-9e89-f615d6e2a8e8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:00.607764 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-edb489df-cf59-4a8b-9e89-f615d6e2a8e8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:00.608555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-edb489df-cf59-4a8b-9e89-f615d6e2a8e8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:00.608992 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-edb489df-cf59-4a8b-9e89-f615d6e2a8e8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:00.626800 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=100 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:00.737162 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-edb489df-cf59-4a8b-9e89-f615d6e2a8e8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:00.745932 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-edb489df-cf59-4a8b-9e89-f615d6e2a8e8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1725 microversion: 2.1 time: 0.149539 Jun 27 09:45:00.746539 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 480/933] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:00 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:00.823243 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-661d1cd0-cc8c-4aef-8854-d01d84afcecb tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:00.823883 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-661d1cd0-cc8c-4aef-8854-d01d84afcecb tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:00.830364 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-661d1cd0-cc8c-4aef-8854-d01d84afcecb tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:00.830814 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-661d1cd0-cc8c-4aef-8854-d01d84afcecb tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:00.831663 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-661d1cd0-cc8c-4aef-8854-d01d84afcecb tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:00.832101 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-661d1cd0-cc8c-4aef-8854-d01d84afcecb tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:00.973452 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-661d1cd0-cc8c-4aef-8854-d01d84afcecb tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:00.981040 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-661d1cd0-cc8c-4aef-8854-d01d84afcecb tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 200 len: 1266 microversion: 2.1 time: 0.161624 Jun 27 09:45:00.981584 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 454/934] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:00 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:01.762147 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-07692a59-4a1c-466e-bde7-cca0fd231772 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:01.762752 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-07692a59-4a1c-466e-bde7-cca0fd231772 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:01.769921 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-07692a59-4a1c-466e-bde7-cca0fd231772 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:01.770365 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-07692a59-4a1c-466e-bde7-cca0fd231772 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:01.771115 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-07692a59-4a1c-466e-bde7-cca0fd231772 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:01.771566 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-07692a59-4a1c-466e-bde7-cca0fd231772 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:01.900466 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-07692a59-4a1c-466e-bde7-cca0fd231772 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:01.908646 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-07692a59-4a1c-466e-bde7-cca0fd231772 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1725 microversion: 2.1 time: 0.150284 Jun 27 09:45:01.909424 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 481/935] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:01 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:01.997920 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-19b3d646-ee2d-4807-9643-47ef8f3cb652 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:01.998470 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-19b3d646-ee2d-4807-9643-47ef8f3cb652 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:02.006173 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-19b3d646-ee2d-4807-9643-47ef8f3cb652 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:02.006695 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-19b3d646-ee2d-4807-9643-47ef8f3cb652 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:02.007554 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-19b3d646-ee2d-4807-9643-47ef8f3cb652 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:02.007995 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-19b3d646-ee2d-4807-9643-47ef8f3cb652 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:02.140823 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-19b3d646-ee2d-4807-9643-47ef8f3cb652 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:02.148256 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-19b3d646-ee2d-4807-9643-47ef8f3cb652 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 200 len: 1266 microversion: 2.1 time: 0.154272 Jun 27 09:45:02.148812 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 455/936] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:01 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:02.926218 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-315eb248-ae89-49d1-9dfd-d4fba9b334e0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:02.926933 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-315eb248-ae89-49d1-9dfd-d4fba9b334e0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:02.933519 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-315eb248-ae89-49d1-9dfd-d4fba9b334e0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:02.933940 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-315eb248-ae89-49d1-9dfd-d4fba9b334e0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:02.934713 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-315eb248-ae89-49d1-9dfd-d4fba9b334e0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:02.935144 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-315eb248-ae89-49d1-9dfd-d4fba9b334e0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:03.062967 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-315eb248-ae89-49d1-9dfd-d4fba9b334e0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:03.071418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-315eb248-ae89-49d1-9dfd-d4fba9b334e0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1725 microversion: 2.1 time: 0.149137 Jun 27 09:45:03.072025 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 482/937] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:02 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:03.236592 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-7fed2be7-99b0-4831-9e79-371e1742e49d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:03.237252 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-7fed2be7-99b0-4831-9e79-371e1742e49d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:03.243926 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7fed2be7-99b0-4831-9e79-371e1742e49d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:03.244374 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7fed2be7-99b0-4831-9e79-371e1742e49d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:03.245134 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7fed2be7-99b0-4831-9e79-371e1742e49d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:03.245560 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7fed2be7-99b0-4831-9e79-371e1742e49d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:03.379149 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-7fed2be7-99b0-4831-9e79-371e1742e49d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:03.386912 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-7fed2be7-99b0-4831-9e79-371e1742e49d tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 200 len: 1266 microversion: 2.1 time: 0.154318 Jun 27 09:45:03.387593 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 456/938] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:03 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:04.088415 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-35579a3a-dcbf-4b06-8087-43e68b9d0ce3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:04.089017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-35579a3a-dcbf-4b06-8087-43e68b9d0ce3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:04.095661 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-35579a3a-dcbf-4b06-8087-43e68b9d0ce3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:04.096002 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-35579a3a-dcbf-4b06-8087-43e68b9d0ce3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:04.096758 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-35579a3a-dcbf-4b06-8087-43e68b9d0ce3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:04.097839 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-35579a3a-dcbf-4b06-8087-43e68b9d0ce3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:04.230656 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-35579a3a-dcbf-4b06-8087-43e68b9d0ce3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:04.238695 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-35579a3a-dcbf-4b06-8087-43e68b9d0ce3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1725 microversion: 2.1 time: 0.154102 Jun 27 09:45:04.239256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 483/939] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:04 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:04.403406 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a1f48663-86d7-45ba-bd64-e6158f6bcfd0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:04.404110 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-a1f48663-86d7-45ba-bd64-e6158f6bcfd0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:04.411177 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a1f48663-86d7-45ba-bd64-e6158f6bcfd0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:04.411670 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a1f48663-86d7-45ba-bd64-e6158f6bcfd0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:04.412443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a1f48663-86d7-45ba-bd64-e6158f6bcfd0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:04.412886 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a1f48663-86d7-45ba-bd64-e6158f6bcfd0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:04.544300 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a1f48663-86d7-45ba-bd64-e6158f6bcfd0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:04.551923 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-a1f48663-86d7-45ba-bd64-e6158f6bcfd0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 200 len: 1266 microversion: 2.1 time: 0.152388 Jun 27 09:45:04.552484 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 457/940] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:04 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:05.256275 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-175997e9-572f-4445-b2e8-ba835068ea9c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:05.256895 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-175997e9-572f-4445-b2e8-ba835068ea9c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:05.263166 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-175997e9-572f-4445-b2e8-ba835068ea9c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:05.263656 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-175997e9-572f-4445-b2e8-ba835068ea9c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:05.264432 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-175997e9-572f-4445-b2e8-ba835068ea9c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:05.264871 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-175997e9-572f-4445-b2e8-ba835068ea9c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:05.391998 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-175997e9-572f-4445-b2e8-ba835068ea9c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:05.400414 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-175997e9-572f-4445-b2e8-ba835068ea9c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1725 microversion: 2.1 time: 0.148518 Jun 27 09:45:05.400977 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 484/941] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:05 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:05.569189 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-254c8523-b7aa-42d0-a532-5d8dc9189dec tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:05.569806 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-254c8523-b7aa-42d0-a532-5d8dc9189dec tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:05.576348 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-254c8523-b7aa-42d0-a532-5d8dc9189dec tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:05.577032 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-254c8523-b7aa-42d0-a532-5d8dc9189dec tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:05.577560 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-254c8523-b7aa-42d0-a532-5d8dc9189dec tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:05.577998 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-254c8523-b7aa-42d0-a532-5d8dc9189dec tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:05.706919 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-254c8523-b7aa-42d0-a532-5d8dc9189dec tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:05.714825 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-254c8523-b7aa-42d0-a532-5d8dc9189dec tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 200 len: 1266 microversion: 2.1 time: 0.149984 Jun 27 09:45:05.715395 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 458/942] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:05 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:05.914406 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-45a28b83-42d9-4267-83b0-269382a74a63 req-346a132d-f77c-4493-9473-aa67b2f0bc35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123a29e5-2f67-47b9-a67e-f8f6c63da8d1", "name": "network-vif-plugged", "status": "completed", "tag": "22d0d7b0-5a8c-4419-bf0c-95ba06adce52"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:45:05.922887 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-45a28b83-42d9-4267-83b0-269382a74a63 req-346a132d-f77c-4493-9473-aa67b2f0bc35 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:05.923342 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-45a28b83-42d9-4267-83b0-269382a74a63 req-346a132d-f77c-4493-9473-aa67b2f0bc35 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:05.934722 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-45a28b83-42d9-4267-83b0-269382a74a63 req-346a132d-f77c-4493-9473-aa67b2f0bc35 service nova] Creating event network-vif-plugged:22d0d7b0-5a8c-4419-bf0c-95ba06adce52 for instance 123a29e5-2f67-47b9-a67e-f8f6c63da8d1 on hv-cinder-84773 Jun 27 09:45:05.939835 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-45a28b83-42d9-4267-83b0-269382a74a63 req-346a132d-f77c-4493-9473-aa67b2f0bc35 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029146 Jun 27 09:45:05.940456 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 485/943] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:45:06.417117 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c9412e7e-5919-4570-bc0a-2d73c5570bb0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:06.417727 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-c9412e7e-5919-4570-bc0a-2d73c5570bb0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:06.423941 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c9412e7e-5919-4570-bc0a-2d73c5570bb0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:06.428061 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c9412e7e-5919-4570-bc0a-2d73c5570bb0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:06.428061 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c9412e7e-5919-4570-bc0a-2d73c5570bb0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:06.428061 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c9412e7e-5919-4570-bc0a-2d73c5570bb0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:06.551176 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-c9412e7e-5919-4570-bc0a-2d73c5570bb0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:06.559197 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-c9412e7e-5919-4570-bc0a-2d73c5570bb0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1725 microversion: 2.1 time: 0.145915 Jun 27 09:45:06.559858 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 459/944] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:06 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:06.732400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-7d25837e-5e83-420b-9fe8-697a660da24c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:06.733104 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-7d25837e-5e83-420b-9fe8-697a660da24c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:06.739826 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7d25837e-5e83-420b-9fe8-697a660da24c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:06.740282 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7d25837e-5e83-420b-9fe8-697a660da24c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:06.741057 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7d25837e-5e83-420b-9fe8-697a660da24c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:06.741496 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7d25837e-5e83-420b-9fe8-697a660da24c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:06.868291 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-7d25837e-5e83-420b-9fe8-697a660da24c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:06.875813 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-7d25837e-5e83-420b-9fe8-697a660da24c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 200 len: 1266 microversion: 2.1 time: 0.147560 Jun 27 09:45:06.885526 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 486/945] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:06 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:07.576153 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-5a901cfa-36a3-4bf0-befc-fac02d09e3f8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:07.576677 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-5a901cfa-36a3-4bf0-befc-fac02d09e3f8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:07.583231 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5a901cfa-36a3-4bf0-befc-fac02d09e3f8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:07.583727 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5a901cfa-36a3-4bf0-befc-fac02d09e3f8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:07.584497 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5a901cfa-36a3-4bf0-befc-fac02d09e3f8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:07.584934 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5a901cfa-36a3-4bf0-befc-fac02d09e3f8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:07.714126 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-5a901cfa-36a3-4bf0-befc-fac02d09e3f8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:07.722396 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-5a901cfa-36a3-4bf0-befc-fac02d09e3f8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1725 microversion: 2.1 time: 0.149680 Jun 27 09:45:07.723380 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 460/946] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:07 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:07.900311 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-ec1672db-910e-434f-9b07-a25ce93304aa tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:07.900952 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-ec1672db-910e-434f-9b07-a25ce93304aa tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:07.907465 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ec1672db-910e-434f-9b07-a25ce93304aa tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:07.907950 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ec1672db-910e-434f-9b07-a25ce93304aa tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:07.908722 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ec1672db-910e-434f-9b07-a25ce93304aa tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:07.909158 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ec1672db-910e-434f-9b07-a25ce93304aa tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:08.041952 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-ec1672db-910e-434f-9b07-a25ce93304aa tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:08.050175 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-ec1672db-910e-434f-9b07-a25ce93304aa tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 200 len: 1453 microversion: 2.1 time: 0.153724 Jun 27 09:45:08.050751 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 487/947] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:07 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:08.067430 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-4e5eb8db-fc19-4c31-a29d-b515cf618c28 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:08.068098 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-4e5eb8db-fc19-4c31-a29d-b515cf618c28 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:08.074994 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4e5eb8db-fc19-4c31-a29d-b515cf618c28 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:08.075457 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4e5eb8db-fc19-4c31-a29d-b515cf618c28 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:08.076264 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4e5eb8db-fc19-4c31-a29d-b515cf618c28 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:08.076707 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4e5eb8db-fc19-4c31-a29d-b515cf618c28 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:08.241802 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4e5eb8db-fc19-4c31-a29d-b515cf618c28 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:08.249871 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-4e5eb8db-fc19-4c31-a29d-b515cf618c28 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 200 len: 1453 microversion: 2.1 time: 0.186590 Jun 27 09:45:08.250498 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 461/948] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:08 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 1453 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:08.740339 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-08ac61d4-025e-4135-b8a7-c581d46ab6a9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:08.740945 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-08ac61d4-025e-4135-b8a7-c581d46ab6a9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:08.747356 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-08ac61d4-025e-4135-b8a7-c581d46ab6a9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:08.747356 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-08ac61d4-025e-4135-b8a7-c581d46ab6a9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:08.748092 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-08ac61d4-025e-4135-b8a7-c581d46ab6a9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:08.748529 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-08ac61d4-025e-4135-b8a7-c581d46ab6a9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:09.021427 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-08ac61d4-025e-4135-b8a7-c581d46ab6a9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:09.029372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-08ac61d4-025e-4135-b8a7-c581d46ab6a9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1725 microversion: 2.1 time: 0.293422 Jun 27 09:45:09.030201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 488/949] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:08 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1725 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:10.046445 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-b833cc8e-1701-497a-a70f-211414f26afa tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:10.047098 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-b833cc8e-1701-497a-a70f-211414f26afa tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:10.053631 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b833cc8e-1701-497a-a70f-211414f26afa tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:10.054088 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b833cc8e-1701-497a-a70f-211414f26afa tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:10.054865 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b833cc8e-1701-497a-a70f-211414f26afa tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:10.055309 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b833cc8e-1701-497a-a70f-211414f26afa tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:10.194872 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-b833cc8e-1701-497a-a70f-211414f26afa tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:10.203183 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-b833cc8e-1701-497a-a70f-211414f26afa tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1725 microversion: 2.1 time: 0.160797 Jun 27 09:45:10.203834 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 462/950] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:10 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:10.268570 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-ec7da221-9a27-4d1e-9103-95524a322bdc req-d2ddeca2-90e1-4d40-bf9c-1cad451353b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "123a29e5-2f67-47b9-a67e-f8f6c63da8d1", "tag": "22d0d7b0-5a8c-4419-bf0c-95ba06adce52"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:45:10.272894 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:10.279253 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-ec7da221-9a27-4d1e-9103-95524a322bdc req-d2ddeca2-90e1-4d40-bf9c-1cad451353b3 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:10.279732 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-ec7da221-9a27-4d1e-9103-95524a322bdc req-d2ddeca2-90e1-4d40-bf9c-1cad451353b3 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:10.296258 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-ec7da221-9a27-4d1e-9103-95524a322bdc req-d2ddeca2-90e1-4d40-bf9c-1cad451353b3 service nova] Creating event network-changed:22d0d7b0-5a8c-4419-bf0c-95ba06adce52 for instance 123a29e5-2f67-47b9-a67e-f8f6c63da8d1 on hv-cinder-84773 Jun 27 09:45:10.301800 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-ec7da221-9a27-4d1e-9103-95524a322bdc req-d2ddeca2-90e1-4d40-bf9c-1cad451353b3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036895 Jun 27 09:45:10.302432 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 489/951] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:45:10.608910 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-49f6f341-26db-4f03-bd7e-2032ba2e5ed7 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2568f109-4492-410b-93e7-fdf503ddd06a", "device": "/dev/sdb"}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:45:10.610537 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-49f6f341-26db-4f03-bd7e-2032ba2e5ed7 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: cf63de97-74f7-4127-84ba-cceb6ff2d9d3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:10.619515 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-49f6f341-26db-4f03-bd7e-2032ba2e5ed7 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:10.619993 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-49f6f341-26db-4f03-bd7e-2032ba2e5ed7 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:10.620771 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-49f6f341-26db-4f03-bd7e-2032ba2e5ed7 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:10.621202 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-49f6f341-26db-4f03-bd7e-2032ba2e5ed7 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:11.221114 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-55837664-e120-4ca6-bdc7-31157a0e6f5a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:11.222345 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-55837664-e120-4ca6-bdc7-31157a0e6f5a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:11.229158 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-55837664-e120-4ca6-bdc7-31157a0e6f5a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:11.229615 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-55837664-e120-4ca6-bdc7-31157a0e6f5a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:11.230397 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-55837664-e120-4ca6-bdc7-31157a0e6f5a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:11.230841 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-55837664-e120-4ca6-bdc7-31157a0e6f5a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:11.281952 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-49f6f341-26db-4f03-bd7e-2032ba2e5ed7 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "POST /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.676769 Jun 27 09:45:11.291717 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 463/952] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 27 09:45:10 2022] POST /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3/os-volume_attachments => generated 194 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:45:11.378896 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-55837664-e120-4ca6-bdc7-31157a0e6f5a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:11.387047 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-55837664-e120-4ca6-bdc7-31157a0e6f5a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1725 microversion: 2.1 time: 0.170109 Jun 27 09:45:11.387628 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 490/953] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:11 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:45:12.405476 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-d10ff5c4-516a-47e4-974d-dcbb0ab01a58 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:12.406164 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-d10ff5c4-516a-47e4-974d-dcbb0ab01a58 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:12.408077 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=57 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:12.413601 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d10ff5c4-516a-47e4-974d-dcbb0ab01a58 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:12.414046 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d10ff5c4-516a-47e4-974d-dcbb0ab01a58 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:12.414858 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d10ff5c4-516a-47e4-974d-dcbb0ab01a58 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:12.415287 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d10ff5c4-516a-47e4-974d-dcbb0ab01a58 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:12.543973 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d10ff5c4-516a-47e4-974d-dcbb0ab01a58 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:12.553134 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-d10ff5c4-516a-47e4-974d-dcbb0ab01a58 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1725 microversion: 2.1 time: 0.152507 Jun 27 09:45:12.553698 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 464/954] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:12 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:13.570424 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-2ff04413-1dd0-4c26-b713-1ed78a01f4a8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:13.571038 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-2ff04413-1dd0-4c26-b713-1ed78a01f4a8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:13.577552 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2ff04413-1dd0-4c26-b713-1ed78a01f4a8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:13.578009 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2ff04413-1dd0-4c26-b713-1ed78a01f4a8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:13.578781 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2ff04413-1dd0-4c26-b713-1ed78a01f4a8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:13.579221 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2ff04413-1dd0-4c26-b713-1ed78a01f4a8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:13.709181 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2ff04413-1dd0-4c26-b713-1ed78a01f4a8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:13.717074 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-2ff04413-1dd0-4c26-b713-1ed78a01f4a8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1725 microversion: 2.1 time: 0.150454 Jun 27 09:45:13.717638 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 491/955] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:13 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:14.733457 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-05f3ce92-9f89-482f-be1e-eda8e3f825d5 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:14.734070 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-05f3ce92-9f89-482f-be1e-eda8e3f825d5 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:14.740994 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-05f3ce92-9f89-482f-be1e-eda8e3f825d5 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:14.741446 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-05f3ce92-9f89-482f-be1e-eda8e3f825d5 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:14.742208 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-05f3ce92-9f89-482f-be1e-eda8e3f825d5 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:14.742637 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-05f3ce92-9f89-482f-be1e-eda8e3f825d5 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:14.872456 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-05f3ce92-9f89-482f-be1e-eda8e3f825d5 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:14.881204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-05f3ce92-9f89-482f-be1e-eda8e3f825d5 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1725 microversion: 2.1 time: 0.151575 Jun 27 09:45:14.881759 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 465/956] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:14 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:15.899398 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-41d77bda-b9af-45c8-9aee-6f02a1f95965 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:15.899974 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-41d77bda-b9af-45c8-9aee-6f02a1f95965 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:15.906562 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-41d77bda-b9af-45c8-9aee-6f02a1f95965 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:15.907017 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-41d77bda-b9af-45c8-9aee-6f02a1f95965 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:15.907810 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-41d77bda-b9af-45c8-9aee-6f02a1f95965 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:15.908254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-41d77bda-b9af-45c8-9aee-6f02a1f95965 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:16.036459 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-41d77bda-b9af-45c8-9aee-6f02a1f95965 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:16.044836 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-41d77bda-b9af-45c8-9aee-6f02a1f95965 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1725 microversion: 2.1 time: 0.149226 Jun 27 09:45:16.045388 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 492/957] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:15 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:17.061722 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-57497156-af98-41d4-8dd1-cbfb81005e1f tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:17.062369 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-57497156-af98-41d4-8dd1-cbfb81005e1f tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:17.068952 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-57497156-af98-41d4-8dd1-cbfb81005e1f tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:17.069405 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-57497156-af98-41d4-8dd1-cbfb81005e1f tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:17.070166 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-57497156-af98-41d4-8dd1-cbfb81005e1f tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:17.070602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-57497156-af98-41d4-8dd1-cbfb81005e1f tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:17.195913 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-57497156-af98-41d4-8dd1-cbfb81005e1f tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:17.203722 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-57497156-af98-41d4-8dd1-cbfb81005e1f tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1702 microversion: 2.1 time: 0.145819 Jun 27 09:45:17.204280 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 466/958] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:17 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1702 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:17.220205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-5fe7869a-a836-44e7-820e-efea4a190a7c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:45:17.227354 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5fe7869a-a836-44e7-820e-efea4a190a7c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:17.227833 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5fe7869a-a836-44e7-820e-efea4a190a7c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:17.286623 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-5fe7869a-a836-44e7-820e-efea4a190a7c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Going to try to start instance {{(pid=124869) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 27 09:45:17.446118 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-5fe7869a-a836-44e7-820e-efea4a190a7c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "POST /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114/action" status: 202 len: 0 microversion: 2.1 time: 0.229558 Jun 27 09:45:17.446732 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 493/959] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 27 09:45:17 2022] POST /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:45:17.454728 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-921e7c5d-dea9-4037-8cff-99be04312b49 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:17.455366 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-921e7c5d-dea9-4037-8cff-99be04312b49 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:17.462036 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-921e7c5d-dea9-4037-8cff-99be04312b49 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:17.462492 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-921e7c5d-dea9-4037-8cff-99be04312b49 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:17.463265 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-921e7c5d-dea9-4037-8cff-99be04312b49 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:17.463745 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-921e7c5d-dea9-4037-8cff-99be04312b49 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:17.592684 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-921e7c5d-dea9-4037-8cff-99be04312b49 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:17.600562 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-921e7c5d-dea9-4037-8cff-99be04312b49 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1711 microversion: 2.1 time: 0.149650 Jun 27 09:45:17.603697 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 467/960] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:17 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1711 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:18.618618 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-3ddddf4c-ba60-4599-8f5b-7c4300063133 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:18.619355 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-3ddddf4c-ba60-4599-8f5b-7c4300063133 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:18.625571 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3ddddf4c-ba60-4599-8f5b-7c4300063133 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:18.626020 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3ddddf4c-ba60-4599-8f5b-7c4300063133 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:18.626788 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3ddddf4c-ba60-4599-8f5b-7c4300063133 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:18.627224 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3ddddf4c-ba60-4599-8f5b-7c4300063133 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:18.757258 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-3ddddf4c-ba60-4599-8f5b-7c4300063133 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:18.765207 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-3ddddf4c-ba60-4599-8f5b-7c4300063133 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1711 microversion: 2.1 time: 0.151427 Jun 27 09:45:18.765943 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 494/961] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:18 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1711 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:19.782745 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e320af25-dc73-49b9-9418-b48386ec2c38 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:19.783347 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e320af25-dc73-49b9-9418-b48386ec2c38 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:19.790243 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e320af25-dc73-49b9-9418-b48386ec2c38 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:19.790681 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e320af25-dc73-49b9-9418-b48386ec2c38 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:19.791451 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e320af25-dc73-49b9-9418-b48386ec2c38 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:19.791896 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e320af25-dc73-49b9-9418-b48386ec2c38 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:19.795996 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:19.927220 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-e320af25-dc73-49b9-9418-b48386ec2c38 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:19.935295 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e320af25-dc73-49b9-9418-b48386ec2c38 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1715 microversion: 2.1 time: 0.156385 Jun 27 09:45:19.935910 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 468/962] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:19 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1715 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:35.830084 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-b1850d12-faa6-4e9f-a93c-61cccf77edb0 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:35.830575 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-b1850d12-faa6-4e9f-a93c-61cccf77edb0 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: cf63de97-74f7-4127-84ba-cceb6ff2d9d3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:35.832759 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=11 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:35.833551 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:35.838137 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b1850d12-faa6-4e9f-a93c-61cccf77edb0 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:35.838588 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b1850d12-faa6-4e9f-a93c-61cccf77edb0 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:35.839390 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b1850d12-faa6-4e9f-a93c-61cccf77edb0 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:35.839886 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b1850d12-faa6-4e9f-a93c-61cccf77edb0 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:35.921649 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.objects.instance [None req-b1850d12-faa6-4e9f-a93c-61cccf77edb0 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lazy-loading 'services' on Instance uuid cf63de97-74f7-4127-84ba-cceb6ff2d9d3 {{(pid=124869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:45:36.152707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-b1850d12-faa6-4e9f-a93c-61cccf77edb0 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "DELETE /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3/os-volume_attachments/2568f109-4492-410b-93e7-fdf503ddd06a" status: 202 len: 0 microversion: 2.1 time: 0.326636 Jun 27 09:45:36.153323 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 495/963] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jun 27 09:45:35 2022] DELETE /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3/os-volume_attachments/2568f109-4492-410b-93e7-fdf503ddd06a => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:45:37.269928 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-d855f668-e899-48f1-a081-a7ce5da8f7a5 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:37.270432 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-d855f668-e899-48f1-a081-a7ce5da8f7a5 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: cf63de97-74f7-4127-84ba-cceb6ff2d9d3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:37.272942 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=9 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:37.277965 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d855f668-e899-48f1-a081-a7ce5da8f7a5 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:37.278420 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d855f668-e899-48f1-a081-a7ce5da8f7a5 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:37.279196 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d855f668-e899-48f1-a081-a7ce5da8f7a5 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:37.279667 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d855f668-e899-48f1-a081-a7ce5da8f7a5 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:37.305466 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-d855f668-e899-48f1-a081-a7ce5da8f7a5 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: cf63de97-74f7-4127-84ba-cceb6ff2d9d3] Going to try to terminate instance {{(pid=124870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 09:45:37.591251 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-d855f668-e899-48f1-a081-a7ce5da8f7a5 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "DELETE /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3" status: 204 len: 0 microversion: 2.1 time: 0.325586 Jun 27 09:45:37.591868 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 469/964] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:45:37 2022] DELETE /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 09:45:37.601509 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-a4ca73aa-d98e-4681-8a30-44aa3ad091b3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:37.602210 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-a4ca73aa-d98e-4681-8a30-44aa3ad091b3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: cf63de97-74f7-4127-84ba-cceb6ff2d9d3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:37.608489 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a4ca73aa-d98e-4681-8a30-44aa3ad091b3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:37.608937 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a4ca73aa-d98e-4681-8a30-44aa3ad091b3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:37.609702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a4ca73aa-d98e-4681-8a30-44aa3ad091b3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:37.610139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a4ca73aa-d98e-4681-8a30-44aa3ad091b3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:37.741603 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-a4ca73aa-d98e-4681-8a30-44aa3ad091b3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:37.748925 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-a4ca73aa-d98e-4681-8a30-44aa3ad091b3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3" status: 200 len: 1514 microversion: 2.1 time: 0.152655 Jun 27 09:45:37.749483 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 496/965] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:37 2022] GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:38.766780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a3a48c6f-ab0c-42f0-8b15-4ad6b1f1fd99 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:38.767485 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-a3a48c6f-ab0c-42f0-8b15-4ad6b1f1fd99 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: cf63de97-74f7-4127-84ba-cceb6ff2d9d3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:38.774035 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a3a48c6f-ab0c-42f0-8b15-4ad6b1f1fd99 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:38.774487 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a3a48c6f-ab0c-42f0-8b15-4ad6b1f1fd99 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:38.775259 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a3a48c6f-ab0c-42f0-8b15-4ad6b1f1fd99 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:38.775733 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a3a48c6f-ab0c-42f0-8b15-4ad6b1f1fd99 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:38.901246 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a3a48c6f-ab0c-42f0-8b15-4ad6b1f1fd99 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:38.908910 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-a3a48c6f-ab0c-42f0-8b15-4ad6b1f1fd99 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3" status: 200 len: 1514 microversion: 2.1 time: 0.146396 Jun 27 09:45:38.909498 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 470/966] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:38 2022] GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:39.895548 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-678d228b-8b16-4b78-8ef9-f5d9c267300b req-f862bd6a-edeb-4b39-a45e-38e50e0bbd4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf63de97-74f7-4127-84ba-cceb6ff2d9d3", "name": "network-vif-deleted", "tag": "11c101a0-eea4-4619-85e4-b0a2c0919c37"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:45:39.904182 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-678d228b-8b16-4b78-8ef9-f5d9c267300b req-f862bd6a-edeb-4b39-a45e-38e50e0bbd4d service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:39.904616 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-678d228b-8b16-4b78-8ef9-f5d9c267300b req-f862bd6a-edeb-4b39-a45e-38e50e0bbd4d service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:39.918397 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-678d228b-8b16-4b78-8ef9-f5d9c267300b req-f862bd6a-edeb-4b39-a45e-38e50e0bbd4d service nova] Creating event network-vif-deleted:11c101a0-eea4-4619-85e4-b0a2c0919c37 for instance cf63de97-74f7-4127-84ba-cceb6ff2d9d3 on hv-cinder-84773 Jun 27 09:45:39.923505 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-678d228b-8b16-4b78-8ef9-f5d9c267300b req-f862bd6a-edeb-4b39-a45e-38e50e0bbd4d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031646 Jun 27 09:45:39.924377 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 497/967] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:45:39.929594 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e9553385-cff3-4547-8dc3-2a2906e54519 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:39.929594 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e9553385-cff3-4547-8dc3-2a2906e54519 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: cf63de97-74f7-4127-84ba-cceb6ff2d9d3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:39.936804 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e9553385-cff3-4547-8dc3-2a2906e54519 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:39.937438 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e9553385-cff3-4547-8dc3-2a2906e54519 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:39.938227 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e9553385-cff3-4547-8dc3-2a2906e54519 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:39.938697 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e9553385-cff3-4547-8dc3-2a2906e54519 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:40.000685 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-e9553385-cff3-4547-8dc3-2a2906e54519 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:40.008218 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e9553385-cff3-4547-8dc3-2a2906e54519 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3" status: 200 len: 1472 microversion: 2.1 time: 0.085009 Jun 27 09:45:40.010655 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 471/968] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:39 2022] GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3 => generated 1472 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:45:41.025857 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-092832e0-31d2-4cd8-b3d3-3598afdfdf95 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:41.026545 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-092832e0-31d2-4cd8-b3d3-3598afdfdf95 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: cf63de97-74f7-4127-84ba-cceb6ff2d9d3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:41.032779 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-092832e0-31d2-4cd8-b3d3-3598afdfdf95 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:41.033219 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-092832e0-31d2-4cd8-b3d3-3598afdfdf95 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:41.033971 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-092832e0-31d2-4cd8-b3d3-3598afdfdf95 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:41.034400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-092832e0-31d2-4cd8-b3d3-3598afdfdf95 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:41.048354 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-092832e0-31d2-4cd8-b3d3-3598afdfdf95 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] HTTP exception thrown: Instance cf63de97-74f7-4127-84ba-cceb6ff2d9d3 could not be found. Jun 27 09:45:41.049969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-092832e0-31d2-4cd8-b3d3-3598afdfdf95 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Request method failure captured: Jun 27 09:45:41.049969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3 HTTP/1.1 Jun 27 09:45:41.049969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:45:41.049969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:45:41.049969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:45:41.049969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:45:41.049969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:45:41.049969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:45:41.049969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:45:41.049969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:45:41.049969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXwGp_jS3JdjL2uuTi1B6QxZgmcfOnyiEqHSAOWtQr52JYWg9I-lvf9Xmimyz3dg8jh0doIvS2BGjSWOh2Q1Ac3xdXyj77DeOZleLYB9HWvTc4rdkFskX701evjM5EBYVMoSXnWeslf9HOyL2IgJLZK2gfrkID2X-E0r1ibFxw2LMaw Jun 27 09:45:41.049969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:45:41.049969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:45:41.049969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:45:41.049969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:45:41.049969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:45:41.049969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:45:41.049969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: 428f2755baac4091a9d78e86090d819b Jun 27 09:45:41.049969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1318717514 Jun 27 09:45:41.049969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:45:41.049969 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:45:41.051699 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/428f2755baac4091a9d78e86090d819b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/428f2755baac4091a9d78e86090d819b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/428f2755baac4091a9d78e86090d819b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_428f2755baac4091a9d78e86090d819b", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:45:41.051699 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-VolumesSnapshotTestJSON-1318717514 Jun 27 09:45:41.051699 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: 428f2755baac4091a9d78e86090d819b Jun 27 09:45:41.051699 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1318717514 Jun 27 09:45:41.051699 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-VolumesSnapshotTestJSON-1318717514-project Jun 27 09:45:41.051699 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:45:41.051699 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:45:41.051699 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: b432b13ffa7d42379fe38d6eed54e75f Jun 27 09:45:41.051699 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-VolumesSnapshotTestJSON-1318717514-project Jun 27 09:45:41.051699 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: > Jun 27 09:45:41.051699 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Instance cf63de97-74f7-4127-84ba-cceb6ff2d9d3 could not be found. Jun 27 09:45:41.051699 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'id': 'cf63de97-74f7-4127-84ba-cceb6ff2d9d3'} Jun 27 09:45:41.052786 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:45:41.052786 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:45:41.052786 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:45:41.052786 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:45:41.052786 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:45:41.052786 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:45:41.052786 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:45:41.052786 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:45:41.052786 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:45:41.052786 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:45:41.052786 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf63de97-74f7-4127-84ba-cceb6ff2d9d3 could not be found. Jun 27 09:45:41.052786 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:45:41.052786 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:45:41.052786 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:45:41.052786 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:45:41.052786 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:45:41.052786 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:45:41.052786 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:45:41.052786 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:45:41.052786 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:45:41.054562 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:45:41.054562 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:45:41.054562 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:45:41.054562 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:45:41.054562 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:45:41.054562 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:45:41.054562 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:45:41.054562 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf63de97-74f7-4127-84ba-cceb6ff2d9d3 could not be found. Jun 27 09:45:41.054562 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:45:41.054562 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:45:41.054562 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:45:41.054562 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:45:41.054562 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:45:41.054562 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:45:41.054562 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:45:41.054562 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:45:41.054562 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf63de97-74f7-4127-84ba-cceb6ff2d9d3 could not be found. Jun 27 09:45:41.054562 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:45:41.056048 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-092832e0-31d2-4cd8-b3d3-3598afdfdf95 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Returning 404 to user: Instance cf63de97-74f7-4127-84ba-cceb6ff2d9d3 could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:45:41.056048 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-092832e0-31d2-4cd8-b3d3-3598afdfdf95 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3" status: 404 len: 111 microversion: 2.1 time: 0.030590 Jun 27 09:45:41.056048 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 498/969] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:41 2022] GET /compute/v2.1/servers/cf63de97-74f7-4127-84ba-cceb6ff2d9d3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:45:51.439948 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-7d483cf0-3719-4e7f-aa7d-7090f2a4c2e9 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1091054184", "imageRef": "96dfa32c-d52f-4225-8918-743ebc97f4bc", "flavorRef": "452", "networks": [{"uuid": "2c7da231-f63f-4eff-bafe-35d3dfbe40f5"}]}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:45:51.449482 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:51.449482 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:51.494131 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.network.neutron [None req-7d483cf0-3719-4e7f-aa7d-7090f2a4c2e9 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] validate_networks() for [('2c7da231-f63f-4eff-bafe-35d3dfbe40f5', None, None, None, None, None)] {{(pid=124870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 09:45:51.828163 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-7d483cf0-3719-4e7f-aa7d-7090f2a4c2e9 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Flavor limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 09:45:51.828685 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-7d483cf0-3719-4e7f-aa7d-7090f2a4c2e9 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Image limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 09:45:51.829204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-7d483cf0-3719-4e7f-aa7d-7090f2a4c2e9 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Flavor pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 09:45:51.829616 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-7d483cf0-3719-4e7f-aa7d-7090f2a4c2e9 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Image pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 09:45:51.830055 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-7d483cf0-3719-4e7f-aa7d-7090f2a4c2e9 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 09:45:51.839272 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7d483cf0-3719-4e7f-aa7d-7090f2a4c2e9 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:51.839756 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7d483cf0-3719-4e7f-aa7d-7090f2a4c2e9 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:51.840545 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7d483cf0-3719-4e7f-aa7d-7090f2a4c2e9 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:51.840973 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7d483cf0-3719-4e7f-aa7d-7090f2a4c2e9 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:51.857068 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-7d483cf0-3719-4e7f-aa7d-7090f2a4c2e9 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Getting quotas for project 428f2755baac4091a9d78e86090d819b. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:45:51.860818 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-7d483cf0-3719-4e7f-aa7d-7090f2a4c2e9 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Getting quotas for user b432b13ffa7d42379fe38d6eed54e75f and project 428f2755baac4091a9d78e86090d819b. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:45:51.871273 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-7d483cf0-3719-4e7f-aa7d-7090f2a4c2e9 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Going to run 1 instances... {{(pid=124870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 09:45:51.873518 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-7d483cf0-3719-4e7f-aa7d-7090f2a4c2e9 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: 09de02f3-ba66-4891-87b3-4fac376a2eea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96dfa32c-d52f-4225-8918-743ebc97f4bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 09:45:52.060987 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-7d483cf0-3719-4e7f-aa7d-7090f2a4c2e9 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624866 Jun 27 09:45:52.061625 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 472/970] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 27 09:45:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 09:45:52.072132 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-c450bd5a-c5db-49ba-859b-2392d78fb27b tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:52.072815 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-c450bd5a-c5db-49ba-859b-2392d78fb27b tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: 09de02f3-ba66-4891-87b3-4fac376a2eea] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:52.076409 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=8 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:52.077137 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:45:52.133604 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-c450bd5a-c5db-49ba-859b-2392d78fb27b tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:52.137894 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-c450bd5a-c5db-49ba-859b-2392d78fb27b tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea" status: 200 len: 1219 microversion: 2.1 time: 0.070346 Jun 27 09:45:52.138459 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 499/971] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:52 2022] GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:53.155357 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-9d3127f6-049f-4ad8-ad72-250339400b25 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:53.156001 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-9d3127f6-049f-4ad8-ad72-250339400b25 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: 09de02f3-ba66-4891-87b3-4fac376a2eea] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:53.162825 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9d3127f6-049f-4ad8-ad72-250339400b25 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:53.163279 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9d3127f6-049f-4ad8-ad72-250339400b25 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:53.164063 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9d3127f6-049f-4ad8-ad72-250339400b25 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:53.164501 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9d3127f6-049f-4ad8-ad72-250339400b25 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:53.224426 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-9d3127f6-049f-4ad8-ad72-250339400b25 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:53.231773 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-9d3127f6-049f-4ad8-ad72-250339400b25 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea" status: 200 len: 1223 microversion: 2.1 time: 0.080859 Jun 27 09:45:53.232325 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 473/972] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:53 2022] GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:54.249167 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-1fff1bf2-7499-4b81-8d14-86eac71a6a90 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:54.249782 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-1fff1bf2-7499-4b81-8d14-86eac71a6a90 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: 09de02f3-ba66-4891-87b3-4fac376a2eea] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:54.258637 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1fff1bf2-7499-4b81-8d14-86eac71a6a90 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:54.259307 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1fff1bf2-7499-4b81-8d14-86eac71a6a90 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:54.260316 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1fff1bf2-7499-4b81-8d14-86eac71a6a90 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:54.260880 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1fff1bf2-7499-4b81-8d14-86eac71a6a90 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:54.330552 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-1fff1bf2-7499-4b81-8d14-86eac71a6a90 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:54.338695 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-1fff1bf2-7499-4b81-8d14-86eac71a6a90 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea" status: 200 len: 1277 microversion: 2.1 time: 0.093492 Jun 27 09:45:54.339263 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 500/973] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:54 2022] GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea => generated 1277 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:55.355614 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-1c071096-5780-463f-b095-7119015bf9af tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:55.356227 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-1c071096-5780-463f-b095-7119015bf9af tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: 09de02f3-ba66-4891-87b3-4fac376a2eea] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:55.362588 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1c071096-5780-463f-b095-7119015bf9af tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:55.363030 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1c071096-5780-463f-b095-7119015bf9af tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:55.371493 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1c071096-5780-463f-b095-7119015bf9af tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:55.371493 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-1c071096-5780-463f-b095-7119015bf9af tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:55.574593 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-1c071096-5780-463f-b095-7119015bf9af tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:55.582019 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-1c071096-5780-463f-b095-7119015bf9af tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea" status: 200 len: 1319 microversion: 2.1 time: 0.230287 Jun 27 09:45:55.582584 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 474/974] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:55 2022] GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:55.802698 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-259872d7-8b45-4cb4-adf9-77c7d1cc11e4 req-0e221363-58f0-4965-9648-bd5a096b75e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09de02f3-ba66-4891-87b3-4fac376a2eea", "tag": "5b1d200b-d2a1-427f-8d90-d205b5740160"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:45:55.811715 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-259872d7-8b45-4cb4-adf9-77c7d1cc11e4 req-0e221363-58f0-4965-9648-bd5a096b75e5 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:55.812214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-259872d7-8b45-4cb4-adf9-77c7d1cc11e4 req-0e221363-58f0-4965-9648-bd5a096b75e5 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:55.824327 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-259872d7-8b45-4cb4-adf9-77c7d1cc11e4 req-0e221363-58f0-4965-9648-bd5a096b75e5 service nova] Creating event network-changed:5b1d200b-d2a1-427f-8d90-d205b5740160 for instance 09de02f3-ba66-4891-87b3-4fac376a2eea on hv-cinder-84773 Jun 27 09:45:55.829187 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-259872d7-8b45-4cb4-adf9-77c7d1cc11e4 req-0e221363-58f0-4965-9648-bd5a096b75e5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030140 Jun 27 09:45:55.829821 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 501/975] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:45:56.598335 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-f40794d9-6684-41fd-8231-d85c81835251 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:56.598862 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-f40794d9-6684-41fd-8231-d85c81835251 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: 09de02f3-ba66-4891-87b3-4fac376a2eea] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:56.605411 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f40794d9-6684-41fd-8231-d85c81835251 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:56.605870 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f40794d9-6684-41fd-8231-d85c81835251 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:56.610866 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f40794d9-6684-41fd-8231-d85c81835251 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:56.610866 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f40794d9-6684-41fd-8231-d85c81835251 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:56.738061 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-f40794d9-6684-41fd-8231-d85c81835251 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:56.745848 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-f40794d9-6684-41fd-8231-d85c81835251 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea" status: 200 len: 1319 microversion: 2.1 time: 0.151530 Jun 27 09:45:56.746413 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 475/976] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:56 2022] GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:57.763384 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-57fa32c6-c794-42dd-8898-b1f4938a62f1 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:57.764126 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-57fa32c6-c794-42dd-8898-b1f4938a62f1 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: 09de02f3-ba66-4891-87b3-4fac376a2eea] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:57.770880 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-57fa32c6-c794-42dd-8898-b1f4938a62f1 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:57.771344 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-57fa32c6-c794-42dd-8898-b1f4938a62f1 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:57.772127 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-57fa32c6-c794-42dd-8898-b1f4938a62f1 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:57.772569 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-57fa32c6-c794-42dd-8898-b1f4938a62f1 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:57.902305 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-57fa32c6-c794-42dd-8898-b1f4938a62f1 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:57.909702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-57fa32c6-c794-42dd-8898-b1f4938a62f1 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea" status: 200 len: 1319 microversion: 2.1 time: 0.150545 Jun 27 09:45:57.910275 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 502/977] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:57 2022] GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:45:58.926394 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-5c102cae-aab7-4d1c-97bb-253eee177963 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:45:58.927011 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-5c102cae-aab7-4d1c-97bb-253eee177963 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: 09de02f3-ba66-4891-87b3-4fac376a2eea] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:45:58.933573 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5c102cae-aab7-4d1c-97bb-253eee177963 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:58.934029 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5c102cae-aab7-4d1c-97bb-253eee177963 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:58.934798 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5c102cae-aab7-4d1c-97bb-253eee177963 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:45:58.935237 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5c102cae-aab7-4d1c-97bb-253eee177963 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:45:59.058844 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-5c102cae-aab7-4d1c-97bb-253eee177963 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:45:59.066190 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-5c102cae-aab7-4d1c-97bb-253eee177963 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea" status: 200 len: 1319 microversion: 2.1 time: 0.143704 Jun 27 09:45:59.074474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 476/978] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:45:58 2022] GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:00.082824 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e5882c09-ff15-4763-bccf-e5b95f5ae2be tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:00.083440 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-e5882c09-ff15-4763-bccf-e5b95f5ae2be tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: 09de02f3-ba66-4891-87b3-4fac376a2eea] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:00.090069 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e5882c09-ff15-4763-bccf-e5b95f5ae2be tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:00.090520 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e5882c09-ff15-4763-bccf-e5b95f5ae2be tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:00.091286 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e5882c09-ff15-4763-bccf-e5b95f5ae2be tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:00.091765 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e5882c09-ff15-4763-bccf-e5b95f5ae2be tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:00.222148 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e5882c09-ff15-4763-bccf-e5b95f5ae2be tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:00.230207 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-e5882c09-ff15-4763-bccf-e5b95f5ae2be tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea" status: 200 len: 1319 microversion: 2.1 time: 0.151382 Jun 27 09:46:00.230760 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 503/979] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:00 2022] GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:01.247280 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e79f75cc-3d3b-47bc-9162-9275ff1c9522 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:01.251695 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e79f75cc-3d3b-47bc-9162-9275ff1c9522 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: 09de02f3-ba66-4891-87b3-4fac376a2eea] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:01.254046 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e79f75cc-3d3b-47bc-9162-9275ff1c9522 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:01.254491 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e79f75cc-3d3b-47bc-9162-9275ff1c9522 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:01.255272 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e79f75cc-3d3b-47bc-9162-9275ff1c9522 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:01.255738 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e79f75cc-3d3b-47bc-9162-9275ff1c9522 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:01.382775 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-e79f75cc-3d3b-47bc-9162-9275ff1c9522 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:01.390180 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e79f75cc-3d3b-47bc-9162-9275ff1c9522 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea" status: 200 len: 1319 microversion: 2.1 time: 0.146717 Jun 27 09:46:01.390763 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 477/980] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:01 2022] GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:01.626294 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-95651063-283b-40da-b9d7-ed539f28f6ed tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:01.626791 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-95651063-283b-40da-b9d7-ed539f28f6ed tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:01.633165 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-95651063-283b-40da-b9d7-ed539f28f6ed tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:01.633616 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-95651063-283b-40da-b9d7-ed539f28f6ed tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:01.634381 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-95651063-283b-40da-b9d7-ed539f28f6ed tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:01.634824 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-95651063-283b-40da-b9d7-ed539f28f6ed tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:01.822372 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.objects.instance [None req-95651063-283b-40da-b9d7-ed539f28f6ed tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lazy-loading 'services' on Instance uuid 852e3cbc-67cd-4e86-b5ba-bdf54a75d114 {{(pid=124869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:46:02.004417 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-95651063-283b-40da-b9d7-ed539f28f6ed tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "DELETE /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114/os-volume_attachments/0b3c1245-6f43-4e30-a650-a45264f3b870" status: 202 len: 0 microversion: 2.1 time: 0.381906 Jun 27 09:46:02.005252 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 504/981] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jun 27 09:46:01 2022] DELETE /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114/os-volume_attachments/0b3c1245-6f43-4e30-a650-a45264f3b870 => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:46:02.092735 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-dd15dcde-b53f-443d-9205-91c3e591831a req-7cd8f56f-c597-4064-8c22-7e764e1f6ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09de02f3-ba66-4891-87b3-4fac376a2eea", "name": "network-vif-plugged", "status": "completed", "tag": "5b1d200b-d2a1-427f-8d90-d205b5740160"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:46:02.096591 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=2 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:02.097429 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=6 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:02.102755 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-dd15dcde-b53f-443d-9205-91c3e591831a req-7cd8f56f-c597-4064-8c22-7e764e1f6ab3 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:02.103204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-dd15dcde-b53f-443d-9205-91c3e591831a req-7cd8f56f-c597-4064-8c22-7e764e1f6ab3 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:02.114821 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-dd15dcde-b53f-443d-9205-91c3e591831a req-7cd8f56f-c597-4064-8c22-7e764e1f6ab3 service nova] Creating event network-vif-plugged:5b1d200b-d2a1-427f-8d90-d205b5740160 for instance 09de02f3-ba66-4891-87b3-4fac376a2eea on hv-cinder-84773 Jun 27 09:46:02.120706 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-dd15dcde-b53f-443d-9205-91c3e591831a req-7cd8f56f-c597-4064-8c22-7e764e1f6ab3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032245 Jun 27 09:46:02.121518 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 478/982] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:46:02.407471 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-54ab06e0-5ac3-41e3-b3ae-26add3e89f92 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:02.408240 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-54ab06e0-5ac3-41e3-b3ae-26add3e89f92 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: 09de02f3-ba66-4891-87b3-4fac376a2eea] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:02.410214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell0:SELECT=2 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:02.415486 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-54ab06e0-5ac3-41e3-b3ae-26add3e89f92 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:02.415980 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-54ab06e0-5ac3-41e3-b3ae-26add3e89f92 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:02.416749 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-54ab06e0-5ac3-41e3-b3ae-26add3e89f92 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:02.417198 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-54ab06e0-5ac3-41e3-b3ae-26add3e89f92 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:02.555921 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-54ab06e0-5ac3-41e3-b3ae-26add3e89f92 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:02.563292 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-54ab06e0-5ac3-41e3-b3ae-26add3e89f92 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea" status: 200 len: 1319 microversion: 2.1 time: 0.160057 Jun 27 09:46:02.563893 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 505/983] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:02 2022] GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:03.116533 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-2ee379c0-62ec-4f6f-89ff-499a41b57604 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:46:03.124100 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2ee379c0-62ec-4f6f-89ff-499a41b57604 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:03.124557 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2ee379c0-62ec-4f6f-89ff-499a41b57604 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:03.145874 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-2ee379c0-62ec-4f6f-89ff-499a41b57604 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Going to try to stop instance {{(pid=124870) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 27 09:46:03.348258 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-2ee379c0-62ec-4f6f-89ff-499a41b57604 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "POST /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114/action" status: 202 len: 0 microversion: 2.1 time: 0.236329 Jun 27 09:46:03.348956 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 479/984] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 27 09:46:03 2022] POST /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:46:03.357145 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-4bfc5061-8017-4a5e-ae42-8ad64dbca830 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:03.358341 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-4bfc5061-8017-4a5e-ae42-8ad64dbca830 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:03.364765 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4bfc5061-8017-4a5e-ae42-8ad64dbca830 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:03.365211 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4bfc5061-8017-4a5e-ae42-8ad64dbca830 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:03.366026 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4bfc5061-8017-4a5e-ae42-8ad64dbca830 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:03.366468 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4bfc5061-8017-4a5e-ae42-8ad64dbca830 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:03.497240 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4bfc5061-8017-4a5e-ae42-8ad64dbca830 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:03.504726 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-4bfc5061-8017-4a5e-ae42-8ad64dbca830 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1679 microversion: 2.1 time: 0.151347 Jun 27 09:46:03.505280 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 506/985] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:03 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:03.581136 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-732b49bc-8822-4d24-9930-fc1f7b5925a1 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:03.581835 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-732b49bc-8822-4d24-9930-fc1f7b5925a1 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: 09de02f3-ba66-4891-87b3-4fac376a2eea] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:03.588892 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-732b49bc-8822-4d24-9930-fc1f7b5925a1 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:03.589344 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-732b49bc-8822-4d24-9930-fc1f7b5925a1 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:03.590159 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-732b49bc-8822-4d24-9930-fc1f7b5925a1 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:03.590593 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-732b49bc-8822-4d24-9930-fc1f7b5925a1 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:03.720659 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-732b49bc-8822-4d24-9930-fc1f7b5925a1 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:03.728714 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-732b49bc-8822-4d24-9930-fc1f7b5925a1 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea" status: 200 len: 1319 microversion: 2.1 time: 0.151752 Jun 27 09:46:03.736916 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 480/986] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:03 2022] GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:04.522375 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-baec2af9-ca86-4bfa-89e3-c9e624f95c72 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:04.523009 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-baec2af9-ca86-4bfa-89e3-c9e624f95c72 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:04.532382 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-baec2af9-ca86-4bfa-89e3-c9e624f95c72 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:04.532830 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-baec2af9-ca86-4bfa-89e3-c9e624f95c72 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:04.533606 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-baec2af9-ca86-4bfa-89e3-c9e624f95c72 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:04.534055 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-baec2af9-ca86-4bfa-89e3-c9e624f95c72 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:04.658127 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-baec2af9-ca86-4bfa-89e3-c9e624f95c72 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:04.665996 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-baec2af9-ca86-4bfa-89e3-c9e624f95c72 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1679 microversion: 2.1 time: 0.147564 Jun 27 09:46:04.666553 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 507/987] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:04 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:04.745861 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-11e84a4a-1037-4165-8e5b-fd76b6d913c3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:04.746601 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-11e84a4a-1037-4165-8e5b-fd76b6d913c3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: 09de02f3-ba66-4891-87b3-4fac376a2eea] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:04.753011 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-11e84a4a-1037-4165-8e5b-fd76b6d913c3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:04.753463 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-11e84a4a-1037-4165-8e5b-fd76b6d913c3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:04.754227 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-11e84a4a-1037-4165-8e5b-fd76b6d913c3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:04.754661 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-11e84a4a-1037-4165-8e5b-fd76b6d913c3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:04.936344 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-11e84a4a-1037-4165-8e5b-fd76b6d913c3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:04.943674 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-11e84a4a-1037-4165-8e5b-fd76b6d913c3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea" status: 200 len: 1508 microversion: 2.1 time: 0.202147 Jun 27 09:46:04.944233 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 481/988] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:04 2022] GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:04.960380 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e8c3d51f-8755-49c9-b12f-424b66ba52c3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d4a8b49-61bb-4d09-a8d8-5772c939a910", "device": "/dev/sdb"}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:46:04.963593 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-e8c3d51f-8755-49c9-b12f-424b66ba52c3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: 09de02f3-ba66-4891-87b3-4fac376a2eea] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:04.969734 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e8c3d51f-8755-49c9-b12f-424b66ba52c3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:04.970182 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e8c3d51f-8755-49c9-b12f-424b66ba52c3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:04.970951 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e8c3d51f-8755-49c9-b12f-424b66ba52c3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:04.971388 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e8c3d51f-8755-49c9-b12f-424b66ba52c3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:05.654284 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-e8c3d51f-8755-49c9-b12f-424b66ba52c3 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "POST /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.697623 Jun 27 09:46:05.654946 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 508/989] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 27 09:46:04 2022] POST /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea/os-volume_attachments => generated 194 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:46:05.684063 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e9210d9d-c767-43bc-9f5f-54b908240e82 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:05.684698 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e9210d9d-c767-43bc-9f5f-54b908240e82 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:05.690742 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e9210d9d-c767-43bc-9f5f-54b908240e82 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:05.691228 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e9210d9d-c767-43bc-9f5f-54b908240e82 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:05.692017 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e9210d9d-c767-43bc-9f5f-54b908240e82 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:05.692596 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e9210d9d-c767-43bc-9f5f-54b908240e82 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:05.823828 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-e9210d9d-c767-43bc-9f5f-54b908240e82 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:05.831380 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e9210d9d-c767-43bc-9f5f-54b908240e82 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1679 microversion: 2.1 time: 0.151137 Jun 27 09:46:05.831951 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 482/990] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:05 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:06.850065 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-77a3955d-be02-4623-951b-5a286bfb0cee tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:06.850804 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-77a3955d-be02-4623-951b-5a286bfb0cee tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:06.857489 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-77a3955d-be02-4623-951b-5a286bfb0cee tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:06.857940 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-77a3955d-be02-4623-951b-5a286bfb0cee tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:06.858700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-77a3955d-be02-4623-951b-5a286bfb0cee tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:06.859137 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-77a3955d-be02-4623-951b-5a286bfb0cee tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:06.990234 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-77a3955d-be02-4623-951b-5a286bfb0cee tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:06.997621 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-77a3955d-be02-4623-951b-5a286bfb0cee tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1679 microversion: 2.1 time: 0.152175 Jun 27 09:46:06.998194 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 509/991] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:06 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:08.014523 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-3129fb9b-22cc-47d1-94e7-66b727edadd9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:08.015141 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-3129fb9b-22cc-47d1-94e7-66b727edadd9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:08.021783 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3129fb9b-22cc-47d1-94e7-66b727edadd9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:08.022176 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3129fb9b-22cc-47d1-94e7-66b727edadd9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:08.022951 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3129fb9b-22cc-47d1-94e7-66b727edadd9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:08.023386 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3129fb9b-22cc-47d1-94e7-66b727edadd9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:08.148612 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-3129fb9b-22cc-47d1-94e7-66b727edadd9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:08.156223 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-3129fb9b-22cc-47d1-94e7-66b727edadd9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1679 microversion: 2.1 time: 0.145585 Jun 27 09:46:08.156791 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 483/992] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:08 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1679 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:09.175410 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-4a126212-5bd7-4502-aeb2-e287debf8def tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:09.176232 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-4a126212-5bd7-4502-aeb2-e287debf8def tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:09.184665 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4a126212-5bd7-4502-aeb2-e287debf8def tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:09.185555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4a126212-5bd7-4502-aeb2-e287debf8def tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:09.185840 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4a126212-5bd7-4502-aeb2-e287debf8def tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:09.186287 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4a126212-5bd7-4502-aeb2-e287debf8def tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:09.321701 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4a126212-5bd7-4502-aeb2-e287debf8def tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:09.329227 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-4a126212-5bd7-4502-aeb2-e287debf8def tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1679 microversion: 2.1 time: 0.159148 Jun 27 09:46:09.329800 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 510/993] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:09 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:10.346683 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-73737a08-3e97-4228-ace8-960f9cc4cc59 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:10.347221 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-73737a08-3e97-4228-ace8-960f9cc4cc59 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:10.354209 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-73737a08-3e97-4228-ace8-960f9cc4cc59 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:10.354661 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-73737a08-3e97-4228-ace8-960f9cc4cc59 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:10.355420 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-73737a08-3e97-4228-ace8-960f9cc4cc59 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:10.355881 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-73737a08-3e97-4228-ace8-960f9cc4cc59 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:10.460976 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 09:46:10.461217 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Mon Jun 27 09:46:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 (ip 10.222.0.64) !!! Jun 27 09:46:10.489427 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-73737a08-3e97-4228-ace8-960f9cc4cc59 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:10.497508 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-73737a08-3e97-4228-ace8-960f9cc4cc59 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1679 microversion: 2.1 time: 0.154783 Jun 27 09:46:10.498070 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 484/994] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:10 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:11.514287 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-1e1b0a9c-0d9c-49f6-91ce-f98d2fd39304 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:11.514902 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-1e1b0a9c-0d9c-49f6-91ce-f98d2fd39304 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:11.521489 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1e1b0a9c-0d9c-49f6-91ce-f98d2fd39304 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:11.521948 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1e1b0a9c-0d9c-49f6-91ce-f98d2fd39304 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:11.523192 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1e1b0a9c-0d9c-49f6-91ce-f98d2fd39304 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:11.523681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1e1b0a9c-0d9c-49f6-91ce-f98d2fd39304 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:11.654399 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-1e1b0a9c-0d9c-49f6-91ce-f98d2fd39304 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:11.661701 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-1e1b0a9c-0d9c-49f6-91ce-f98d2fd39304 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1679 microversion: 2.1 time: 0.151378 Jun 27 09:46:11.662263 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 511/995] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:11 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:12.678452 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-2006fea1-030c-4451-bac5-8f55e6a02e36 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:12.679102 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-2006fea1-030c-4451-bac5-8f55e6a02e36 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:12.686193 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2006fea1-030c-4451-bac5-8f55e6a02e36 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:12.686644 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2006fea1-030c-4451-bac5-8f55e6a02e36 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:12.687414 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2006fea1-030c-4451-bac5-8f55e6a02e36 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:12.687944 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-2006fea1-030c-4451-bac5-8f55e6a02e36 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:12.815053 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-2006fea1-030c-4451-bac5-8f55e6a02e36 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:12.822556 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-2006fea1-030c-4451-bac5-8f55e6a02e36 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1679 microversion: 2.1 time: 0.147918 Jun 27 09:46:12.823118 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 485/996] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:12 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:13.839624 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-6ad28737-4831-4ac8-8f60-b3cf68397e5c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:13.840232 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-6ad28737-4831-4ac8-8f60-b3cf68397e5c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:13.846707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6ad28737-4831-4ac8-8f60-b3cf68397e5c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:13.847151 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6ad28737-4831-4ac8-8f60-b3cf68397e5c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:13.847931 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6ad28737-4831-4ac8-8f60-b3cf68397e5c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:13.848363 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6ad28737-4831-4ac8-8f60-b3cf68397e5c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:13.978215 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6ad28737-4831-4ac8-8f60-b3cf68397e5c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:13.985578 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-6ad28737-4831-4ac8-8f60-b3cf68397e5c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1679 microversion: 2.1 time: 0.149875 Jun 27 09:46:13.986155 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 512/997] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:13 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:15.003012 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-562bc9fd-e5d6-4529-bb70-e5c75bc0ed41 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:15.003645 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-562bc9fd-e5d6-4529-bb70-e5c75bc0ed41 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:15.010746 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-562bc9fd-e5d6-4529-bb70-e5c75bc0ed41 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:15.011195 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-562bc9fd-e5d6-4529-bb70-e5c75bc0ed41 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:15.011994 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-562bc9fd-e5d6-4529-bb70-e5c75bc0ed41 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:15.012460 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-562bc9fd-e5d6-4529-bb70-e5c75bc0ed41 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:15.138692 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-562bc9fd-e5d6-4529-bb70-e5c75bc0ed41 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:15.146148 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-562bc9fd-e5d6-4529-bb70-e5c75bc0ed41 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1656 microversion: 2.1 time: 0.147087 Jun 27 09:46:15.146701 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 486/998] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:14 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1656 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:15.162779 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-786c5499-6e3d-4b25-af81-92f1f2b77ccb tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:46:15.169246 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-786c5499-6e3d-4b25-af81-92f1f2b77ccb tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:15.169692 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-786c5499-6e3d-4b25-af81-92f1f2b77ccb tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:15.191341 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-786c5499-6e3d-4b25-af81-92f1f2b77ccb tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Going to try to start instance {{(pid=124869) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 27 09:46:15.347704 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-786c5499-6e3d-4b25-af81-92f1f2b77ccb tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "POST /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114/action" status: 202 len: 0 microversion: 2.1 time: 0.188423 Jun 27 09:46:15.348320 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 513/999] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 27 09:46:15 2022] POST /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:46:15.356487 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-db9592f3-ecb1-4d3d-8e96-72cd4310d609 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:15.357080 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-db9592f3-ecb1-4d3d-8e96-72cd4310d609 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:15.363105 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-db9592f3-ecb1-4d3d-8e96-72cd4310d609 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:15.363595 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-db9592f3-ecb1-4d3d-8e96-72cd4310d609 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:15.364374 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-db9592f3-ecb1-4d3d-8e96-72cd4310d609 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:15.364818 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-db9592f3-ecb1-4d3d-8e96-72cd4310d609 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:15.490807 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-db9592f3-ecb1-4d3d-8e96-72cd4310d609 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:15.498735 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-db9592f3-ecb1-4d3d-8e96-72cd4310d609 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1665 microversion: 2.1 time: 0.146142 Jun 27 09:46:15.499305 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 487/1000] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:15 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1665 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:16.517580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-c60b4c4c-73a4-4d1a-99f3-2f4dc1deafa3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:16.518276 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-c60b4c4c-73a4-4d1a-99f3-2f4dc1deafa3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:16.524456 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c60b4c4c-73a4-4d1a-99f3-2f4dc1deafa3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:16.524902 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c60b4c4c-73a4-4d1a-99f3-2f4dc1deafa3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:16.525657 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c60b4c4c-73a4-4d1a-99f3-2f4dc1deafa3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:16.526089 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c60b4c4c-73a4-4d1a-99f3-2f4dc1deafa3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:16.530029 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:16.659337 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-c60b4c4c-73a4-4d1a-99f3-2f4dc1deafa3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:16.667381 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-c60b4c4c-73a4-4d1a-99f3-2f4dc1deafa3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1665 microversion: 2.1 time: 0.154587 Jun 27 09:46:16.667978 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 514/1001] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:16 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:17.685076 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-01b4a7a6-717d-4357-867b-6def68ae8579 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:17.685690 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-01b4a7a6-717d-4357-867b-6def68ae8579 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:17.692098 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-01b4a7a6-717d-4357-867b-6def68ae8579 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:17.692543 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-01b4a7a6-717d-4357-867b-6def68ae8579 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:17.693300 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-01b4a7a6-717d-4357-867b-6def68ae8579 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:17.693735 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-01b4a7a6-717d-4357-867b-6def68ae8579 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:17.819248 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-01b4a7a6-717d-4357-867b-6def68ae8579 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:17.823346 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:17.827602 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-01b4a7a6-717d-4357-867b-6def68ae8579 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1665 microversion: 2.1 time: 0.146326 Jun 27 09:46:17.828160 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 488/1002] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:17 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1665 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:18.844531 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-49df8112-2cd6-44ff-b535-e7a599a7254d tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:18.845138 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-49df8112-2cd6-44ff-b535-e7a599a7254d tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:18.851654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-49df8112-2cd6-44ff-b535-e7a599a7254d tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:18.852100 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-49df8112-2cd6-44ff-b535-e7a599a7254d tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:18.852857 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-49df8112-2cd6-44ff-b535-e7a599a7254d tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:18.853285 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-49df8112-2cd6-44ff-b535-e7a599a7254d tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:18.983072 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-49df8112-2cd6-44ff-b535-e7a599a7254d tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:18.988451 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-49df8112-2cd6-44ff-b535-e7a599a7254d tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1669 microversion: 2.1 time: 0.147784 Jun 27 09:46:18.989006 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 515/1003] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:18 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1669 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:46:25.674353 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-68aa7d57-35fc-46bd-a6db-35616f9e9499 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:25.674874 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-68aa7d57-35fc-46bd-a6db-35616f9e9499 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: 09de02f3-ba66-4891-87b3-4fac376a2eea] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:25.677408 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:25.682460 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-68aa7d57-35fc-46bd-a6db-35616f9e9499 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:25.689358 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-68aa7d57-35fc-46bd-a6db-35616f9e9499 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:25.689358 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-68aa7d57-35fc-46bd-a6db-35616f9e9499 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:25.689358 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-68aa7d57-35fc-46bd-a6db-35616f9e9499 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:25.762792 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.objects.instance [None req-68aa7d57-35fc-46bd-a6db-35616f9e9499 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lazy-loading 'services' on Instance uuid 09de02f3-ba66-4891-87b3-4fac376a2eea {{(pid=124870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:46:25.961586 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-68aa7d57-35fc-46bd-a6db-35616f9e9499 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "DELETE /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea/os-volume_attachments/3d4a8b49-61bb-4d09-a8d8-5772c939a910" status: 202 len: 0 microversion: 2.1 time: 0.291075 Jun 27 09:46:25.962236 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 489/1004] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jun 27 09:46:25 2022] DELETE /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea/os-volume_attachments/3d4a8b49-61bb-4d09-a8d8-5772c939a910 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:46:27.069264 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-9d8bfa39-fa82-4fcf-a0ba-1147e4b9932f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:27.070329 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-9d8bfa39-fa82-4fcf-a0ba-1147e4b9932f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: 09de02f3-ba66-4891-87b3-4fac376a2eea] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:27.074083 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=37 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:27.077591 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9d8bfa39-fa82-4fcf-a0ba-1147e4b9932f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:27.078048 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9d8bfa39-fa82-4fcf-a0ba-1147e4b9932f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:27.081184 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9d8bfa39-fa82-4fcf-a0ba-1147e4b9932f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:27.081184 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-9d8bfa39-fa82-4fcf-a0ba-1147e4b9932f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:27.104375 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-9d8bfa39-fa82-4fcf-a0ba-1147e4b9932f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: 09de02f3-ba66-4891-87b3-4fac376a2eea] Going to try to terminate instance {{(pid=124869) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 09:46:27.369989 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-9d8bfa39-fa82-4fcf-a0ba-1147e4b9932f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "DELETE /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea" status: 204 len: 0 microversion: 2.1 time: 0.304276 Jun 27 09:46:27.370629 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 516/1005] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:46:27 2022] DELETE /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 09:46:27.386932 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-13f0cbfa-95fe-4c88-82df-5e04beef978f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:27.387679 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-13f0cbfa-95fe-4c88-82df-5e04beef978f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: 09de02f3-ba66-4891-87b3-4fac376a2eea] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:27.394148 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-13f0cbfa-95fe-4c88-82df-5e04beef978f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:27.394603 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-13f0cbfa-95fe-4c88-82df-5e04beef978f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:27.395374 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-13f0cbfa-95fe-4c88-82df-5e04beef978f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:27.395843 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-13f0cbfa-95fe-4c88-82df-5e04beef978f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:27.527206 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-13f0cbfa-95fe-4c88-82df-5e04beef978f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:27.534659 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-13f0cbfa-95fe-4c88-82df-5e04beef978f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea" status: 200 len: 1514 microversion: 2.1 time: 0.152789 Jun 27 09:46:27.535221 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 490/1006] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:27 2022] GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:28.552873 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-ac6b3986-0248-4fc8-a3e4-38fe028be93c tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:28.553523 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-ac6b3986-0248-4fc8-a3e4-38fe028be93c tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: 09de02f3-ba66-4891-87b3-4fac376a2eea] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:28.560457 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ac6b3986-0248-4fc8-a3e4-38fe028be93c tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:28.560900 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ac6b3986-0248-4fc8-a3e4-38fe028be93c tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:28.561659 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ac6b3986-0248-4fc8-a3e4-38fe028be93c tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:28.562092 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ac6b3986-0248-4fc8-a3e4-38fe028be93c tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:28.691916 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-ac6b3986-0248-4fc8-a3e4-38fe028be93c tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:28.699292 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-ac6b3986-0248-4fc8-a3e4-38fe028be93c tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea" status: 200 len: 1514 microversion: 2.1 time: 0.150690 Jun 27 09:46:28.699869 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 517/1007] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:28 2022] GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:29.572334 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-83ba6b7d-9a53-41c8-97d0-9da46cc9e69c req-99fe8a18-c2ff-4fa1-955e-92905fde890a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09de02f3-ba66-4891-87b3-4fac376a2eea", "name": "network-vif-deleted", "tag": "5b1d200b-d2a1-427f-8d90-d205b5740160"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:46:29.580336 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-83ba6b7d-9a53-41c8-97d0-9da46cc9e69c req-99fe8a18-c2ff-4fa1-955e-92905fde890a service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:29.580778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-83ba6b7d-9a53-41c8-97d0-9da46cc9e69c req-99fe8a18-c2ff-4fa1-955e-92905fde890a service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:29.593246 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-83ba6b7d-9a53-41c8-97d0-9da46cc9e69c req-99fe8a18-c2ff-4fa1-955e-92905fde890a service nova] Creating event network-vif-deleted:5b1d200b-d2a1-427f-8d90-d205b5740160 for instance 09de02f3-ba66-4891-87b3-4fac376a2eea on hv-cinder-84773 Jun 27 09:46:29.598201 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-83ba6b7d-9a53-41c8-97d0-9da46cc9e69c req-99fe8a18-c2ff-4fa1-955e-92905fde890a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030596 Jun 27 09:46:29.598797 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 491/1008] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:46:29.716486 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-56ded226-7eaa-485c-8de3-f0e773a0b8f2 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:29.717039 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-56ded226-7eaa-485c-8de3-f0e773a0b8f2 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: 09de02f3-ba66-4891-87b3-4fac376a2eea] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:29.723599 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-56ded226-7eaa-485c-8de3-f0e773a0b8f2 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:29.724078 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-56ded226-7eaa-485c-8de3-f0e773a0b8f2 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:29.724894 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-56ded226-7eaa-485c-8de3-f0e773a0b8f2 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:29.725329 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-56ded226-7eaa-485c-8de3-f0e773a0b8f2 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:29.789855 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-56ded226-7eaa-485c-8de3-f0e773a0b8f2 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b432b13ffa7d42379fe38d6eed54e75f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f2755baac4091a9d78e86090d819b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:29.796772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-56ded226-7eaa-485c-8de3-f0e773a0b8f2 tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea" status: 200 len: 1304 microversion: 2.1 time: 0.084271 Jun 27 09:46:29.797259 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 518/1009] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:29 2022] GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea => generated 1304 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:46:30.815129 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a489fc04-8de7-4d2f-a8e8-db6c596e4f0f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:30.815884 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-a489fc04-8de7-4d2f-a8e8-db6c596e4f0f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] [instance: 09de02f3-ba66-4891-87b3-4fac376a2eea] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:30.822580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a489fc04-8de7-4d2f-a8e8-db6c596e4f0f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:30.823031 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a489fc04-8de7-4d2f-a8e8-db6c596e4f0f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:30.823817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a489fc04-8de7-4d2f-a8e8-db6c596e4f0f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:30.824254 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a489fc04-8de7-4d2f-a8e8-db6c596e4f0f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:30.837966 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-a489fc04-8de7-4d2f-a8e8-db6c596e4f0f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] HTTP exception thrown: Instance 09de02f3-ba66-4891-87b3-4fac376a2eea could not be found. Jun 27 09:46:30.839582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a489fc04-8de7-4d2f-a8e8-db6c596e4f0f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Request method failure captured: Jun 27 09:46:30.839582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea HTTP/1.1 Jun 27 09:46:30.839582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:46:30.839582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:46:30.839582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:46:30.839582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:46:30.839582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:46:30.839582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:46:30.839582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:46:30.839582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:46:30.839582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXwGp_jS3JdjL2uuTi1B6QxZgmcfOnyiEqHSAOWtQr52JYWg9I-lvf9Xmimyz3dg8jh0doIvS2BGjSWOh2Q1Ac3xdXyj77DeOZleLYB9HWvTc4rdkFskX701evjM5EBYVMoSXnWeslf9HOyL2IgJLZK2gfrkID2X-E0r1ibFxw2LMaw Jun 27 09:46:30.839582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:46:30.839582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:46:30.839582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:46:30.839582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:46:30.839582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:46:30.839582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:46:30.839582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: 428f2755baac4091a9d78e86090d819b Jun 27 09:46:30.839582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1318717514 Jun 27 09:46:30.839582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:46:30.839582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:46:30.841304 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/428f2755baac4091a9d78e86090d819b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/428f2755baac4091a9d78e86090d819b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/428f2755baac4091a9d78e86090d819b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_428f2755baac4091a9d78e86090d819b", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:46:30.841304 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-VolumesSnapshotTestJSON-1318717514 Jun 27 09:46:30.841304 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: 428f2755baac4091a9d78e86090d819b Jun 27 09:46:30.841304 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1318717514 Jun 27 09:46:30.841304 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-VolumesSnapshotTestJSON-1318717514-project Jun 27 09:46:30.841304 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:46:30.841304 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:46:30.841304 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: b432b13ffa7d42379fe38d6eed54e75f Jun 27 09:46:30.841304 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-VolumesSnapshotTestJSON-1318717514-project Jun 27 09:46:30.841304 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: > Jun 27 09:46:30.841304 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Instance 09de02f3-ba66-4891-87b3-4fac376a2eea could not be found. Jun 27 09:46:30.841304 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': '09de02f3-ba66-4891-87b3-4fac376a2eea'} Jun 27 09:46:30.842361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:46:30.842361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:46:30.842361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:46:30.842361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:46:30.842361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:46:30.842361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:46:30.842361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:46:30.842361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:46:30.842361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:46:30.842361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:46:30.842361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09de02f3-ba66-4891-87b3-4fac376a2eea could not be found. Jun 27 09:46:30.842361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:46:30.842361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:46:30.842361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:46:30.842361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:46:30.842361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:46:30.842361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:46:30.842361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:46:30.842361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:46:30.842361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:46:30.843764 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:46:30.843764 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:46:30.843764 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:46:30.843764 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:46:30.843764 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:46:30.843764 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:46:30.843764 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:46:30.843764 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09de02f3-ba66-4891-87b3-4fac376a2eea could not be found. Jun 27 09:46:30.843764 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:46:30.843764 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:46:30.843764 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:46:30.843764 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:46:30.843764 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:46:30.843764 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:46:30.843764 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:46:30.843764 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:46:30.843764 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09de02f3-ba66-4891-87b3-4fac376a2eea could not be found. Jun 27 09:46:30.843764 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:46:30.845335 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a489fc04-8de7-4d2f-a8e8-db6c596e4f0f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] Returning 404 to user: Instance 09de02f3-ba66-4891-87b3-4fac376a2eea could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:46:30.845335 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-a489fc04-8de7-4d2f-a8e8-db6c596e4f0f tempest-VolumesSnapshotTestJSON-1318717514 tempest-VolumesSnapshotTestJSON-1318717514-project] 10.222.0.64 "GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea" status: 404 len: 111 microversion: 2.1 time: 0.030514 Jun 27 09:46:30.845335 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 492/1010] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:30 2022] GET /compute/v2.1/servers/09de02f3-ba66-4891-87b3-4fac376a2eea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:46:50.409621 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-5d6476aa-d930-48f1-a6b5-ef0f4bee1d9f tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:50.410456 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-5d6476aa-d930-48f1-a6b5-ef0f4bee1d9f tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:50.410599 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-f236aafc-efbb-4a6e-8245-90646d088ed8 req-f353bb9c-6398-4384-a93a-4143dc28fb3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "123a29e5-2f67-47b9-a67e-f8f6c63da8d1", "tag": "22d0d7b0-5a8c-4419-bf0c-95ba06adce52"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:46:50.413608 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:50.414368 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:50.415843 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=7 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:50.416680 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:46:50.420010 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5d6476aa-d930-48f1-a6b5-ef0f4bee1d9f tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:50.420536 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5d6476aa-d930-48f1-a6b5-ef0f4bee1d9f tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:50.421641 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5d6476aa-d930-48f1-a6b5-ef0f4bee1d9f tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:50.422336 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5d6476aa-d930-48f1-a6b5-ef0f4bee1d9f tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:50.423093 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-f236aafc-efbb-4a6e-8245-90646d088ed8 req-f353bb9c-6398-4384-a93a-4143dc28fb3a service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:50.423731 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-f236aafc-efbb-4a6e-8245-90646d088ed8 req-f353bb9c-6398-4384-a93a-4143dc28fb3a service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:50.435764 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-f236aafc-efbb-4a6e-8245-90646d088ed8 req-f353bb9c-6398-4384-a93a-4143dc28fb3a service nova] Creating event network-changed:22d0d7b0-5a8c-4419-bf0c-95ba06adce52 for instance 123a29e5-2f67-47b9-a67e-f8f6c63da8d1 on hv-cinder-84773 Jun 27 09:46:50.441739 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-f236aafc-efbb-4a6e-8245-90646d088ed8 req-f353bb9c-6398-4384-a93a-4143dc28fb3a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035675 Jun 27 09:46:50.442842 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 493/1011] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:46:50.451647 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-5d6476aa-d930-48f1-a6b5-ef0f4bee1d9f tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Going to try to terminate instance {{(pid=124869) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 09:46:50.808180 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-5d6476aa-d930-48f1-a6b5-ef0f4bee1d9f tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "DELETE /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 204 len: 0 microversion: 2.1 time: 0.402891 Jun 27 09:46:50.809156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 519/1012] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:46:50 2022] DELETE /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 09:46:50.818862 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e153d2ca-e6ef-48d8-9dbc-996ab29f7fbd tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:50.820286 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e153d2ca-e6ef-48d8-9dbc-996ab29f7fbd tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:50.827704 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e153d2ca-e6ef-48d8-9dbc-996ab29f7fbd tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:50.828176 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e153d2ca-e6ef-48d8-9dbc-996ab29f7fbd tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:50.829143 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e153d2ca-e6ef-48d8-9dbc-996ab29f7fbd tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:50.829591 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e153d2ca-e6ef-48d8-9dbc-996ab29f7fbd tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:50.966847 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-e153d2ca-e6ef-48d8-9dbc-996ab29f7fbd tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:50.974635 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e153d2ca-e6ef-48d8-9dbc-996ab29f7fbd tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 200 len: 1577 microversion: 2.1 time: 0.160874 Jun 27 09:46:50.975224 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 494/1013] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:50 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:51.993908 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-c904a183-9358-47e8-9526-dd948284fe89 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:51.995085 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-c904a183-9358-47e8-9526-dd948284fe89 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:52.002023 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c904a183-9358-47e8-9526-dd948284fe89 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:52.002466 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c904a183-9358-47e8-9526-dd948284fe89 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:52.003225 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c904a183-9358-47e8-9526-dd948284fe89 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:52.003687 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-c904a183-9358-47e8-9526-dd948284fe89 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:52.134560 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-c904a183-9358-47e8-9526-dd948284fe89 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:52.143074 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-c904a183-9358-47e8-9526-dd948284fe89 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 200 len: 1577 microversion: 2.1 time: 0.153892 Jun 27 09:46:52.143680 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 520/1014] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:51 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:53.160203 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-54281bfd-3541-4248-8d85-455ad895d56c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:53.160870 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-54281bfd-3541-4248-8d85-455ad895d56c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:53.167385 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-54281bfd-3541-4248-8d85-455ad895d56c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:53.167960 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-54281bfd-3541-4248-8d85-455ad895d56c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:53.168730 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-54281bfd-3541-4248-8d85-455ad895d56c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:53.169173 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-54281bfd-3541-4248-8d85-455ad895d56c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:53.179101 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-3f4c3f7d-a15c-4a52-a8db-40528f85ee36 req-b322688f-df33-4c30-bdf9-77aa2eae07c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123a29e5-2f67-47b9-a67e-f8f6c63da8d1", "name": "network-vif-deleted", "tag": "22d0d7b0-5a8c-4419-bf0c-95ba06adce52"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:46:53.188718 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-3f4c3f7d-a15c-4a52-a8db-40528f85ee36 req-b322688f-df33-4c30-bdf9-77aa2eae07c1 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:53.189164 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-3f4c3f7d-a15c-4a52-a8db-40528f85ee36 req-b322688f-df33-4c30-bdf9-77aa2eae07c1 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:53.201341 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-3f4c3f7d-a15c-4a52-a8db-40528f85ee36 req-b322688f-df33-4c30-bdf9-77aa2eae07c1 service nova] Creating event network-vif-deleted:22d0d7b0-5a8c-4419-bf0c-95ba06adce52 for instance 123a29e5-2f67-47b9-a67e-f8f6c63da8d1 on hv-cinder-84773 Jun 27 09:46:53.206855 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-3f4c3f7d-a15c-4a52-a8db-40528f85ee36 req-b322688f-df33-4c30-bdf9-77aa2eae07c1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091073 Jun 27 09:46:53.211432 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 495/1015] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:46:53.240289 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-54281bfd-3541-4248-8d85-455ad895d56c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:53.245975 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-54281bfd-3541-4248-8d85-455ad895d56c tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 200 len: 1391 microversion: 2.1 time: 0.089593 Jun 27 09:46:53.246538 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 521/1016] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:53 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 1391 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:46:54.263545 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-0323b7d4-fb43-42c3-9c52-42280568c001 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:54.264445 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-0323b7d4-fb43-42c3-9c52-42280568c001 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 123a29e5-2f67-47b9-a67e-f8f6c63da8d1] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:54.271065 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0323b7d4-fb43-42c3-9c52-42280568c001 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:54.271701 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0323b7d4-fb43-42c3-9c52-42280568c001 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:54.272531 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0323b7d4-fb43-42c3-9c52-42280568c001 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:54.272973 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-0323b7d4-fb43-42c3-9c52-42280568c001 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:54.287773 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-0323b7d4-fb43-42c3-9c52-42280568c001 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] HTTP exception thrown: Instance 123a29e5-2f67-47b9-a67e-f8f6c63da8d1 could not be found. Jun 27 09:46:54.289443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-0323b7d4-fb43-42c3-9c52-42280568c001 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Request method failure captured: Jun 27 09:46:54.289443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 HTTP/1.1 Jun 27 09:46:54.289443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:46:54.289443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:46:54.289443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:46:54.289443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:46:54.289443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:46:54.289443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:46:54.289443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:46:54.289443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:46:54.289443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXrKJ0sl3youQvE_D_4Ht9u2HFsuYgBgTX6DegLCY_ccCw9Axr0Yw4ikyfrNS517XJKQhYV2ERTEEf23rjHye8Ux6C2rJtHLtDMZ7Wq9N4_MQ2vz1k1OBPJPdykHjY6P2Oh1_dmZ71fy3x7unHYIPtq-CmCyHxPLeZiIJNvhMR3swsA Jun 27 09:46:54.289443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:46:54.289443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:46:54.289443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:46:54.289443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:46:54.289443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:46:54.289443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:46:54.289443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: 1d5cbd080e204408aa51c29ec2cf1422 Jun 27 09:46:54.289443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-TestVolumeBootPattern-611261078 Jun 27 09:46:54.289443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:46:54.289443 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:46:54.291171 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1d5cbd080e204408aa51c29ec2cf1422"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1d5cbd080e204408aa51c29ec2cf1422"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1d5cbd080e204408aa51c29ec2cf1422"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1d5cbd080e204408aa51c29ec2cf1422", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:46:54.291171 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-TestVolumeBootPattern-611261078 Jun 27 09:46:54.291171 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: 1d5cbd080e204408aa51c29ec2cf1422 Jun 27 09:46:54.291171 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-TestVolumeBootPattern-611261078 Jun 27 09:46:54.291171 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-TestVolumeBootPattern-611261078-project Jun 27 09:46:54.291171 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:46:54.291171 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:46:54.291171 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: 2720d45854ab4a61b3b22dd43a523d4b Jun 27 09:46:54.291171 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-TestVolumeBootPattern-611261078-project Jun 27 09:46:54.291171 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: > Jun 27 09:46:54.291171 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Instance 123a29e5-2f67-47b9-a67e-f8f6c63da8d1 could not be found. Jun 27 09:46:54.291171 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': '123a29e5-2f67-47b9-a67e-f8f6c63da8d1'} Jun 27 09:46:54.292785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:46:54.292785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:46:54.292785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:46:54.292785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:46:54.292785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:46:54.292785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:46:54.292785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:46:54.292785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:46:54.292785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:46:54.292785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:46:54.292785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 123a29e5-2f67-47b9-a67e-f8f6c63da8d1 could not be found. Jun 27 09:46:54.292785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:46:54.292785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:46:54.292785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:46:54.292785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:46:54.292785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:46:54.292785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:46:54.292785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:46:54.292785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:46:54.292785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:46:54.294891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:46:54.294891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:46:54.294891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:46:54.294891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:46:54.294891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:46:54.294891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:46:54.294891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:46:54.294891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 123a29e5-2f67-47b9-a67e-f8f6c63da8d1 could not be found. Jun 27 09:46:54.294891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:46:54.294891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:46:54.294891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:46:54.294891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:46:54.294891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:46:54.294891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:46:54.294891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:46:54.294891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:46:54.294891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 123a29e5-2f67-47b9-a67e-f8f6c63da8d1 could not be found. Jun 27 09:46:54.294891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:46:54.296675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-0323b7d4-fb43-42c3-9c52-42280568c001 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Returning 404 to user: Instance 123a29e5-2f67-47b9-a67e-f8f6c63da8d1 could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:46:54.296675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-0323b7d4-fb43-42c3-9c52-42280568c001 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1" status: 404 len: 111 microversion: 2.1 time: 0.032230 Jun 27 09:46:54.296675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 496/1017] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:54 2022] GET /compute/v2.1/servers/123a29e5-2f67-47b9-a67e-f8f6c63da8d1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:46:57.575142 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-1b92e3fb-9c6a-47b4-9da2-fa385d91f119 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:57.576260 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-1b92e3fb-9c6a-47b4-9da2-fa385d91f119 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:57.582833 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1b92e3fb-9c6a-47b4-9da2-fa385d91f119 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:57.583375 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1b92e3fb-9c6a-47b4-9da2-fa385d91f119 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:57.584239 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1b92e3fb-9c6a-47b4-9da2-fa385d91f119 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:57.584676 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1b92e3fb-9c6a-47b4-9da2-fa385d91f119 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:57.616214 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-1b92e3fb-9c6a-47b4-9da2-fa385d91f119 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045637 Jun 27 09:46:57.616778 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 522/1018] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 27 09:46:57 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 09:46:57.684072 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a1207830-2b58-4e8e-bdcd-15bb79001d28 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:57.684599 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-a1207830-2b58-4e8e-bdcd-15bb79001d28 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:57.693176 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a1207830-2b58-4e8e-bdcd-15bb79001d28 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:57.694258 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a1207830-2b58-4e8e-bdcd-15bb79001d28 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:57.695299 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a1207830-2b58-4e8e-bdcd-15bb79001d28 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:57.696066 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a1207830-2b58-4e8e-bdcd-15bb79001d28 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:57.731685 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-a1207830-2b58-4e8e-bdcd-15bb79001d28 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Going to try to terminate instance {{(pid=124870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 09:46:57.943256 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-cb9f2cbc-3649-4841-babb-51aee389b9a0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:57.943786 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-cb9f2cbc-3649-4841-babb-51aee389b9a0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:57.950844 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-cb9f2cbc-3649-4841-babb-51aee389b9a0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:57.953699 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-cb9f2cbc-3649-4841-babb-51aee389b9a0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:57.954662 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-cb9f2cbc-3649-4841-babb-51aee389b9a0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:57.955999 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-cb9f2cbc-3649-4841-babb-51aee389b9a0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:57.983109 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-cb9f2cbc-3649-4841-babb-51aee389b9a0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Going to try to terminate instance {{(pid=124869) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 09:46:58.032622 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-a1207830-2b58-4e8e-bdcd-15bb79001d28 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "DELETE /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 204 len: 0 microversion: 2.1 time: 0.352533 Jun 27 09:46:58.033132 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 497/1019] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:46:57 2022] DELETE /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 09:46:58.038001 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-c59915a9-b959-48f3-b37a-85a0955ef194 req-c841e8d5-8df9-495d-948e-6d01f804385d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba58e72-a234-48f3-9163-461f3255f4b4", "tag": "ce6fb0fd-6c30-49fd-ba23-057daf263c03"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:46:58.046290 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-c59915a9-b959-48f3-b37a-85a0955ef194 req-c841e8d5-8df9-495d-948e-6d01f804385d service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:58.046737 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-c59915a9-b959-48f3-b37a-85a0955ef194 req-c841e8d5-8df9-495d-948e-6d01f804385d service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:58.058067 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-c59915a9-b959-48f3-b37a-85a0955ef194 req-c841e8d5-8df9-495d-948e-6d01f804385d service nova] Creating event network-changed:ce6fb0fd-6c30-49fd-ba23-057daf263c03 for instance 7ba58e72-a234-48f3-9163-461f3255f4b4 on hv-cinder-84773 Jun 27 09:46:58.063735 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-c59915a9-b959-48f3-b37a-85a0955ef194 req-c841e8d5-8df9-495d-948e-6d01f804385d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029290 Jun 27 09:46:58.064326 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 498/1020] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:46:58.074979 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-b1dfa5bd-7f5d-42ee-8240-8c61be2f6a95 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:58.074979 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-b1dfa5bd-7f5d-42ee-8240-8c61be2f6a95 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:58.076827 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b1dfa5bd-7f5d-42ee-8240-8c61be2f6a95 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:58.077278 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b1dfa5bd-7f5d-42ee-8240-8c61be2f6a95 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:58.078225 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b1dfa5bd-7f5d-42ee-8240-8c61be2f6a95 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:58.078665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b1dfa5bd-7f5d-42ee-8240-8c61be2f6a95 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:58.218107 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-b1dfa5bd-7f5d-42ee-8240-8c61be2f6a95 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:58.226989 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-b1dfa5bd-7f5d-42ee-8240-8c61be2f6a95 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1675 microversion: 2.1 time: 0.161432 Jun 27 09:46:58.227829 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 499/1021] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:58 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:58.292913 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-cb9f2cbc-3649-4841-babb-51aee389b9a0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4" status: 204 len: 0 microversion: 2.1 time: 0.353221 Jun 27 09:46:58.294128 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 523/1022] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:46:57 2022] DELETE /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 09:46:58.302754 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-28f066e6-984a-4b7d-8fa5-bc37f1ba57f6 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:58.303361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-28f066e6-984a-4b7d-8fa5-bc37f1ba57f6 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:58.310230 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-28f066e6-984a-4b7d-8fa5-bc37f1ba57f6 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:58.310672 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-28f066e6-984a-4b7d-8fa5-bc37f1ba57f6 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:58.311430 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-28f066e6-984a-4b7d-8fa5-bc37f1ba57f6 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:58.311887 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-28f066e6-984a-4b7d-8fa5-bc37f1ba57f6 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:58.461259 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-28f066e6-984a-4b7d-8fa5-bc37f1ba57f6 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:58.469171 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-28f066e6-984a-4b7d-8fa5-bc37f1ba57f6 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4" status: 200 len: 1576 microversion: 2.1 time: 0.170228 Jun 27 09:46:58.469757 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 500/1023] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:58 2022] GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:46:59.245710 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-669cc4e3-a935-4eae-ae65-ab6d982622fe tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:59.246418 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-669cc4e3-a935-4eae-ae65-ab6d982622fe tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:59.252869 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-669cc4e3-a935-4eae-ae65-ab6d982622fe tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:59.253321 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-669cc4e3-a935-4eae-ae65-ab6d982622fe tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:59.254094 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-669cc4e3-a935-4eae-ae65-ab6d982622fe tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:59.254535 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-669cc4e3-a935-4eae-ae65-ab6d982622fe tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:59.448468 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-669cc4e3-a935-4eae-ae65-ab6d982622fe tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:59.457838 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-669cc4e3-a935-4eae-ae65-ab6d982622fe tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1675 microversion: 2.1 time: 0.216392 Jun 27 09:46:59.459332 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 524/1024] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:59 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1675 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:46:59.486251 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-07b7631e-a825-4fd2-9c29-e50490df53e0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:46:59.487091 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-07b7631e-a825-4fd2-9c29-e50490df53e0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:46:59.493127 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-07b7631e-a825-4fd2-9c29-e50490df53e0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:59.493595 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-07b7631e-a825-4fd2-9c29-e50490df53e0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:59.500720 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-07b7631e-a825-4fd2-9c29-e50490df53e0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:46:59.500720 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-07b7631e-a825-4fd2-9c29-e50490df53e0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:46:59.692135 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-07b7631e-a825-4fd2-9c29-e50490df53e0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:46:59.699736 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-07b7631e-a825-4fd2-9c29-e50490df53e0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4" status: 200 len: 1576 microversion: 2.1 time: 0.217335 Jun 27 09:46:59.700304 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 501/1025] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:46:59 2022] GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 => generated 1576 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:00.475508 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-b8b8278b-8e5d-45b5-a81b-645a86f239d8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:00.476173 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-b8b8278b-8e5d-45b5-a81b-645a86f239d8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:00.483056 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b8b8278b-8e5d-45b5-a81b-645a86f239d8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:00.483503 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b8b8278b-8e5d-45b5-a81b-645a86f239d8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:00.484302 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b8b8278b-8e5d-45b5-a81b-645a86f239d8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:00.484742 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b8b8278b-8e5d-45b5-a81b-645a86f239d8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:00.614459 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-b8b8278b-8e5d-45b5-a81b-645a86f239d8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:00.625749 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-b8b8278b-8e5d-45b5-a81b-645a86f239d8 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1675 microversion: 2.1 time: 0.154118 Jun 27 09:47:00.626868 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 525/1026] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:00 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:00.718656 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-89fa442c-b65c-41f2-a439-70eea3d61520 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:00.719740 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-89fa442c-b65c-41f2-a439-70eea3d61520 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:00.727981 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-89fa442c-b65c-41f2-a439-70eea3d61520 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:00.728360 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-89fa442c-b65c-41f2-a439-70eea3d61520 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:00.729130 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-89fa442c-b65c-41f2-a439-70eea3d61520 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:00.729565 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-89fa442c-b65c-41f2-a439-70eea3d61520 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:00.967504 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-89fa442c-b65c-41f2-a439-70eea3d61520 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:00.973589 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-89fa442c-b65c-41f2-a439-70eea3d61520 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4" status: 200 len: 1576 microversion: 2.1 time: 0.260430 Jun 27 09:47:00.974519 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 502/1027] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:00 2022] GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 => generated 1576 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:01.643690 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-eab9e7ba-a10e-414f-acc8-f64c19955c10 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:01.645215 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-eab9e7ba-a10e-414f-acc8-f64c19955c10 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:01.653033 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-eab9e7ba-a10e-414f-acc8-f64c19955c10 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:01.653837 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-eab9e7ba-a10e-414f-acc8-f64c19955c10 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:01.655116 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-eab9e7ba-a10e-414f-acc8-f64c19955c10 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:01.656678 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-eab9e7ba-a10e-414f-acc8-f64c19955c10 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:01.862771 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-eab9e7ba-a10e-414f-acc8-f64c19955c10 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:01.872022 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-eab9e7ba-a10e-414f-acc8-f64c19955c10 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1675 microversion: 2.1 time: 0.233549 Jun 27 09:47:01.874042 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 526/1028] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:01 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1675 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:01.990683 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-798516e7-ae26-4d1d-bbe2-42ec256bfe97 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:01.991442 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-798516e7-ae26-4d1d-bbe2-42ec256bfe97 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:01.998376 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-798516e7-ae26-4d1d-bbe2-42ec256bfe97 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:02.007217 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-798516e7-ae26-4d1d-bbe2-42ec256bfe97 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:02.009273 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-798516e7-ae26-4d1d-bbe2-42ec256bfe97 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:02.009273 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-798516e7-ae26-4d1d-bbe2-42ec256bfe97 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:02.412986 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-1d4dc810-d156-4d77-b5c2-ed014bd1df66 req-04382ba3-1bc1-49f0-945c-04606204d769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852e3cbc-67cd-4e86-b5ba-bdf54a75d114", "name": "network-vif-deleted", "tag": "4b0d10bc-c18e-4f05-ade6-67243610a1f6"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:47:02.425787 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-1d4dc810-d156-4d77-b5c2-ed014bd1df66 req-04382ba3-1bc1-49f0-945c-04606204d769 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:02.426231 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-1d4dc810-d156-4d77-b5c2-ed014bd1df66 req-04382ba3-1bc1-49f0-945c-04606204d769 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:02.442976 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-1d4dc810-d156-4d77-b5c2-ed014bd1df66 req-04382ba3-1bc1-49f0-945c-04606204d769 service nova] Creating event network-vif-deleted:4b0d10bc-c18e-4f05-ade6-67243610a1f6 for instance 852e3cbc-67cd-4e86-b5ba-bdf54a75d114 on hv-cinder-84773 Jun 27 09:47:02.448468 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-1d4dc810-d156-4d77-b5c2-ed014bd1df66 req-04382ba3-1bc1-49f0-945c-04606204d769 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044003 Jun 27 09:47:02.449956 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 527/1029] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:47:02.785272 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-798516e7-ae26-4d1d-bbe2-42ec256bfe97 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:02.794734 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-798516e7-ae26-4d1d-bbe2-42ec256bfe97 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4" status: 200 len: 1576 microversion: 2.1 time: 0.808159 Jun 27 09:47:02.796132 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 503/1030] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:01 2022] GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 => generated 1576 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:02.890653 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-b6cf1bc3-04d2-48d4-b7d7-cb04dffd9378 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:02.892122 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-b6cf1bc3-04d2-48d4-b7d7-cb04dffd9378 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:02.900340 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b6cf1bc3-04d2-48d4-b7d7-cb04dffd9378 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:02.900964 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b6cf1bc3-04d2-48d4-b7d7-cb04dffd9378 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:02.901946 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b6cf1bc3-04d2-48d4-b7d7-cb04dffd9378 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:02.902523 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b6cf1bc3-04d2-48d4-b7d7-cb04dffd9378 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:02.936438 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b6cf1bc3-04d2-48d4-b7d7-cb04dffd9378 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:02.936888 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-b6cf1bc3-04d2-48d4-b7d7-cb04dffd9378 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:02.937339 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.objects.instance [None req-b6cf1bc3-04d2-48d4-b7d7-cb04dffd9378 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lazy-loading 'fault' on Instance uuid 852e3cbc-67cd-4e86-b5ba-bdf54a75d114 {{(pid=124869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:47:02.978137 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-b6cf1bc3-04d2-48d4-b7d7-cb04dffd9378 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:02.986952 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-b6cf1bc3-04d2-48d4-b7d7-cb04dffd9378 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 200 len: 1327 microversion: 2.1 time: 0.100899 Jun 27 09:47:02.988159 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 528/1031] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:02 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:03.155008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-8383be80-0c77-44e8-a076-371581d21c13 req-e0b7055b-b966-4d9b-9ccd-2a2768f6e83d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba58e72-a234-48f3-9163-461f3255f4b4", "name": "network-vif-deleted", "tag": "ce6fb0fd-6c30-49fd-ba23-057daf263c03"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:47:03.163725 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-8383be80-0c77-44e8-a076-371581d21c13 req-e0b7055b-b966-4d9b-9ccd-2a2768f6e83d service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:03.164179 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-8383be80-0c77-44e8-a076-371581d21c13 req-e0b7055b-b966-4d9b-9ccd-2a2768f6e83d service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:03.177150 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-8383be80-0c77-44e8-a076-371581d21c13 req-e0b7055b-b966-4d9b-9ccd-2a2768f6e83d service nova] Creating event network-vif-deleted:ce6fb0fd-6c30-49fd-ba23-057daf263c03 for instance 7ba58e72-a234-48f3-9163-461f3255f4b4 on hv-cinder-84773 Jun 27 09:47:03.182467 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-8383be80-0c77-44e8-a076-371581d21c13 req-e0b7055b-b966-4d9b-9ccd-2a2768f6e83d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031587 Jun 27 09:47:03.183848 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 504/1032] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:47:03.815055 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-78d3a2a4-ad73-4307-9d5a-2dd7d3659d07 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:03.815968 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-78d3a2a4-ad73-4307-9d5a-2dd7d3659d07 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:03.826101 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-78d3a2a4-ad73-4307-9d5a-2dd7d3659d07 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:03.826749 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-78d3a2a4-ad73-4307-9d5a-2dd7d3659d07 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:03.827904 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-78d3a2a4-ad73-4307-9d5a-2dd7d3659d07 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:03.828633 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-78d3a2a4-ad73-4307-9d5a-2dd7d3659d07 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:03.889749 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-78d3a2a4-ad73-4307-9d5a-2dd7d3659d07 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:03.890281 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-78d3a2a4-ad73-4307-9d5a-2dd7d3659d07 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:03.890996 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.objects.instance [None req-78d3a2a4-ad73-4307-9d5a-2dd7d3659d07 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lazy-loading 'fault' on Instance uuid 7ba58e72-a234-48f3-9163-461f3255f4b4 {{(pid=124869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:47:03.953838 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-78d3a2a4-ad73-4307-9d5a-2dd7d3659d07 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2720d45854ab4a61b3b22dd43a523d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5cbd080e204408aa51c29ec2cf1422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:03.965875 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-78d3a2a4-ad73-4307-9d5a-2dd7d3659d07 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4" status: 200 len: 1229 microversion: 2.1 time: 0.155694 Jun 27 09:47:03.966772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 529/1033] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:03 2022] GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 => generated 1229 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:04.012174 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-44f95bc6-e682-4b2b-b302-81f092248e04 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:04.013066 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-44f95bc6-e682-4b2b-b302-81f092248e04 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:04.021352 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-44f95bc6-e682-4b2b-b302-81f092248e04 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:04.021913 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-44f95bc6-e682-4b2b-b302-81f092248e04 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:04.022801 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-44f95bc6-e682-4b2b-b302-81f092248e04 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:04.023337 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-44f95bc6-e682-4b2b-b302-81f092248e04 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:04.037830 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-44f95bc6-e682-4b2b-b302-81f092248e04 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] HTTP exception thrown: Instance 852e3cbc-67cd-4e86-b5ba-bdf54a75d114 could not be found. Jun 27 09:47:04.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-44f95bc6-e682-4b2b-b302-81f092248e04 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Request method failure captured: Jun 27 09:47:04.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 HTTP/1.1 Jun 27 09:47:04.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:47:04.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:47:04.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:47:04.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:47:04.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:47:04.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:47:04.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:47:04.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:47:04.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXvTrKIM95Pl7M9bFizxrCjoYgXqZOGIOTgZztOpR4fZUnBlhtPiHmJhZSnQqBQYLezPxjdfGlVsj5vWXnklQYhWzfCz05hpVbQE-rkvs9r6OgOnoOQw_3GFTI51wSXKW2wVxrTemH93QhntzwGkwnvFmUUTy_scFphGDs24Y_5thc8 Jun 27 09:47:04.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:47:04.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:47:04.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:47:04.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:47:04.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:47:04.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:47:04.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: 422340b9e5834d16bff3539c549fc4c1 Jun 27 09:47:04.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-AttachVolumeTestJSON-881212709 Jun 27 09:47:04.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:47:04.039627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:47:04.041355 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/422340b9e5834d16bff3539c549fc4c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/422340b9e5834d16bff3539c549fc4c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/422340b9e5834d16bff3539c549fc4c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_422340b9e5834d16bff3539c549fc4c1", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:47:04.041355 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-AttachVolumeTestJSON-881212709 Jun 27 09:47:04.041355 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: 422340b9e5834d16bff3539c549fc4c1 Jun 27 09:47:04.041355 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-AttachVolumeTestJSON-881212709 Jun 27 09:47:04.041355 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-AttachVolumeTestJSON-881212709-project Jun 27 09:47:04.041355 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:47:04.041355 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:47:04.041355 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: 222b727863844d2b95a9c7222a56a94c Jun 27 09:47:04.041355 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-AttachVolumeTestJSON-881212709-project Jun 27 09:47:04.041355 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: > Jun 27 09:47:04.041355 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Instance 852e3cbc-67cd-4e86-b5ba-bdf54a75d114 could not be found. Jun 27 09:47:04.041355 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': '852e3cbc-67cd-4e86-b5ba-bdf54a75d114'} Jun 27 09:47:04.042442 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:47:04.042442 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:47:04.042442 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:47:04.042442 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:47:04.042442 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:47:04.042442 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:47:04.042442 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:47:04.042442 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:47:04.042442 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:47:04.042442 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:47:04.042442 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 852e3cbc-67cd-4e86-b5ba-bdf54a75d114 could not be found. Jun 27 09:47:04.042442 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:47:04.042442 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:47:04.042442 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:47:04.042442 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:47:04.042442 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:47:04.042442 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:47:04.042442 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:47:04.042442 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:47:04.042442 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:47:04.043980 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:47:04.043980 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:47:04.043980 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:47:04.043980 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:47:04.043980 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:47:04.043980 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:47:04.043980 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:47:04.043980 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 852e3cbc-67cd-4e86-b5ba-bdf54a75d114 could not be found. Jun 27 09:47:04.043980 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:47:04.043980 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:47:04.043980 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:47:04.043980 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:47:04.043980 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:47:04.043980 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:47:04.043980 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:47:04.043980 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:47:04.043980 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 852e3cbc-67cd-4e86-b5ba-bdf54a75d114 could not be found. Jun 27 09:47:04.043980 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:47:04.045313 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-44f95bc6-e682-4b2b-b302-81f092248e04 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Returning 404 to user: Instance 852e3cbc-67cd-4e86-b5ba-bdf54a75d114 could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:47:04.045313 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-44f95bc6-e682-4b2b-b302-81f092248e04 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 404 len: 111 microversion: 2.1 time: 0.040659 Jun 27 09:47:04.045313 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 505/1034] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:03 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:47:04.052391 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-9e6a8edd-464e-4e3e-b366-eeedd3f492e9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '.version_select at 0x7ffa974be790>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:04.159064 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-9e6a8edd-464e-4e3e-b366-eeedd3f492e9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1633212746" status: 202 len: 0 microversion: 2.1 time: 0.110101 Jun 27 09:47:04.160252 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 530/1035] 10.222.0.64 () {58 vars in 1220 bytes} [Mon Jun 27 09:47:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1633212746 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 09:47:04.986345 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-f68b1460-b886-472e-9840-fa714f8baa14 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:04.987156 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-f68b1460-b886-472e-9840-fa714f8baa14 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 7ba58e72-a234-48f3-9163-461f3255f4b4] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:04.996627 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f68b1460-b886-472e-9840-fa714f8baa14 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:04.997574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f68b1460-b886-472e-9840-fa714f8baa14 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:04.998658 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f68b1460-b886-472e-9840-fa714f8baa14 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:05.000216 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f68b1460-b886-472e-9840-fa714f8baa14 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:05.024690 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-f68b1460-b886-472e-9840-fa714f8baa14 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] HTTP exception thrown: Instance 7ba58e72-a234-48f3-9163-461f3255f4b4 could not be found. Jun 27 09:47:05.026788 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-f68b1460-b886-472e-9840-fa714f8baa14 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Request method failure captured: Jun 27 09:47:05.026788 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 HTTP/1.1 Jun 27 09:47:05.026788 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:47:05.026788 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:47:05.026788 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:47:05.026788 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:47:05.026788 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:47:05.026788 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:47:05.026788 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:47:05.026788 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:47:05.026788 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXrKJ0sl3youQvE_D_4Ht9u2HFsuYgBgTX6DegLCY_ccCw9Axr0Yw4ikyfrNS517XJKQhYV2ERTEEf23rjHye8Ux6C2rJtHLtDMZ7Wq9N4_MQ2vz1k1OBPJPdykHjY6P2Oh1_dmZ71fy3x7unHYIPtq-CmCyHxPLeZiIJNvhMR3swsA Jun 27 09:47:05.026788 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:47:05.026788 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:47:05.026788 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:47:05.026788 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:47:05.026788 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:47:05.026788 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:47:05.026788 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: 1d5cbd080e204408aa51c29ec2cf1422 Jun 27 09:47:05.026788 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-TestVolumeBootPattern-611261078 Jun 27 09:47:05.026788 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:47:05.026788 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:47:05.029064 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1d5cbd080e204408aa51c29ec2cf1422"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1d5cbd080e204408aa51c29ec2cf1422"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1d5cbd080e204408aa51c29ec2cf1422"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1d5cbd080e204408aa51c29ec2cf1422", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:47:05.029064 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-TestVolumeBootPattern-611261078 Jun 27 09:47:05.029064 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: 1d5cbd080e204408aa51c29ec2cf1422 Jun 27 09:47:05.029064 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-TestVolumeBootPattern-611261078 Jun 27 09:47:05.029064 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-TestVolumeBootPattern-611261078-project Jun 27 09:47:05.029064 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:47:05.029064 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:47:05.029064 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: 2720d45854ab4a61b3b22dd43a523d4b Jun 27 09:47:05.029064 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-TestVolumeBootPattern-611261078-project Jun 27 09:47:05.029064 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: > Jun 27 09:47:05.029064 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Instance 7ba58e72-a234-48f3-9163-461f3255f4b4 could not be found. Jun 27 09:47:05.029064 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': '7ba58e72-a234-48f3-9163-461f3255f4b4'} Jun 27 09:47:05.030249 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:47:05.030249 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:47:05.030249 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:47:05.030249 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:47:05.030249 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:47:05.030249 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:47:05.030249 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:47:05.030249 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:47:05.030249 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:47:05.030249 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:47:05.030249 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ba58e72-a234-48f3-9163-461f3255f4b4 could not be found. Jun 27 09:47:05.030249 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:47:05.030249 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:47:05.030249 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:47:05.030249 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:47:05.030249 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:47:05.030249 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:47:05.030249 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:47:05.030249 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:47:05.030249 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:47:05.036469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:47:05.036469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:47:05.036469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:47:05.036469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:47:05.036469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:47:05.036469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:47:05.036469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:47:05.036469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ba58e72-a234-48f3-9163-461f3255f4b4 could not be found. Jun 27 09:47:05.036469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:47:05.036469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:47:05.036469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:47:05.036469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:47:05.036469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:47:05.036469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:47:05.036469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:47:05.036469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:47:05.036469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ba58e72-a234-48f3-9163-461f3255f4b4 could not be found. Jun 27 09:47:05.036469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:47:05.038435 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-f68b1460-b886-472e-9840-fa714f8baa14 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Returning 404 to user: Instance 7ba58e72-a234-48f3-9163-461f3255f4b4 could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:47:05.038435 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-f68b1460-b886-472e-9840-fa714f8baa14 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4" status: 404 len: 111 microversion: 2.1 time: 0.051762 Jun 27 09:47:05.038435 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 506/1036] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:04 2022] GET /compute/v2.1/servers/7ba58e72-a234-48f3-9163-461f3255f4b4 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:47:05.253777 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-26b16232-c04f-4ea3-ad44-38d7ee2b6ca9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Action: 'create', calling method: .version_select at 0x7ffa9724ae50>, body: {"keypair": {"name": "tempest-keypair-1114211473", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtwRPSvadLGTwnsDA+xbedZ/7N4fcUv3IU0iRN5v29Yqub6ZWMPXFQz/XdTauX63Sdf1F+N6VACJlZnmPoJ/LO7Do+982R5tT0bvAvJ19ykkZnLYipGhBFoaa+Zaxrrsg=="}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:47:05.287050 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-26b16232-c04f-4ea3-ad44-38d7ee2b6ca9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Getting quotas for project 422340b9e5834d16bff3539c549fc4c1. Resources: {'key_pairs'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:47:05.293540 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-26b16232-c04f-4ea3-ad44-38d7ee2b6ca9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Getting quotas for user 222b727863844d2b95a9c7222a56a94c and project 422340b9e5834d16bff3539c549fc4c1. Resources: {'key_pairs'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:47:05.440456 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-26b16232-c04f-4ea3-ad44-38d7ee2b6ca9 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.192608 Jun 27 09:47:05.442262 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 531/1037] 10.222.0.64 () {60 vars in 1158 bytes} [Mon Jun 27 09:47:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:47:05.727096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-829e80f7-4262-4743-9549-97162fdfd4e4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:05.727623 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-829e80f7-4262-4743-9549-97162fdfd4e4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:05.734670 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-829e80f7-4262-4743-9549-97162fdfd4e4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:05.735301 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-829e80f7-4262-4743-9549-97162fdfd4e4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:05.736255 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-829e80f7-4262-4743-9549-97162fdfd4e4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:05.736817 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-829e80f7-4262-4743-9549-97162fdfd4e4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:05.752678 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-829e80f7-4262-4743-9549-97162fdfd4e4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] HTTP exception thrown: Instance 3cb9074b-9ac1-4780-ab45-dde1641b83e3 could not be found. Jun 27 09:47:05.754008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-829e80f7-4262-4743-9549-97162fdfd4e4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Request method failure captured: Jun 27 09:47:05.754008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: DELETE /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 HTTP/1.1 Jun 27 09:47:05.754008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:47:05.754008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:47:05.754008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:47:05.754008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:47:05.754008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:47:05.754008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:47:05.754008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:47:05.754008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:47:05.754008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXrKJ0sl3youQvE_D_4Ht9u2HFsuYgBgTX6DegLCY_ccCw9Axr0Yw4ikyfrNS517XJKQhYV2ERTEEf23rjHye8Ux6C2rJtHLtDMZ7Wq9N4_MQ2vz1k1OBPJPdykHjY6P2Oh1_dmZ71fy3x7unHYIPtq-CmCyHxPLeZiIJNvhMR3swsA Jun 27 09:47:05.754008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:47:05.754008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:47:05.754008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:47:05.754008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:47:05.754008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:47:05.754008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:47:05.754008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: 1d5cbd080e204408aa51c29ec2cf1422 Jun 27 09:47:05.754008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-TestVolumeBootPattern-611261078 Jun 27 09:47:05.754008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:47:05.754008 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:47:05.755676 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1d5cbd080e204408aa51c29ec2cf1422"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1d5cbd080e204408aa51c29ec2cf1422"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1d5cbd080e204408aa51c29ec2cf1422"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1d5cbd080e204408aa51c29ec2cf1422", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:47:05.755676 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-TestVolumeBootPattern-611261078 Jun 27 09:47:05.755676 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: 1d5cbd080e204408aa51c29ec2cf1422 Jun 27 09:47:05.755676 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-TestVolumeBootPattern-611261078 Jun 27 09:47:05.755676 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-TestVolumeBootPattern-611261078-project Jun 27 09:47:05.755676 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:47:05.755676 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:47:05.755676 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: 2720d45854ab4a61b3b22dd43a523d4b Jun 27 09:47:05.755676 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-TestVolumeBootPattern-611261078-project Jun 27 09:47:05.755676 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: > Jun 27 09:47:05.755676 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Instance 3cb9074b-9ac1-4780-ab45-dde1641b83e3 could not be found. Jun 27 09:47:05.755676 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': '3cb9074b-9ac1-4780-ab45-dde1641b83e3'} Jun 27 09:47:05.756615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:47:05.756615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:47:05.756615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:47:05.756615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:47:05.756615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:47:05.756615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:47:05.756615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:47:05.756615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:47:05.756615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:47:05.756615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:47:05.756615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cb9074b-9ac1-4780-ab45-dde1641b83e3 could not be found. Jun 27 09:47:05.756615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:47:05.756615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:47:05.756615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:47:05.756615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:47:05.756615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:47:05.756615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:47:05.756615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:47:05.756615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:47:05.756615 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:47:05.758127 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:47:05.758127 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 09:47:05.758127 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 09:47:05.758127 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 09:47:05.758127 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 09:47:05.758127 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:47:05.758127 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:47:05.758127 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:47:05.758127 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:47:05.758127 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cb9074b-9ac1-4780-ab45-dde1641b83e3 could not be found. Jun 27 09:47:05.758127 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:47:05.758127 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:47:05.758127 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:47:05.758127 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:47:05.758127 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:47:05.758127 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:47:05.758127 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:47:05.758127 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:47:05.758127 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cb9074b-9ac1-4780-ab45-dde1641b83e3 could not be found. Jun 27 09:47:05.758127 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:47:05.761405 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-829e80f7-4262-4743-9549-97162fdfd4e4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Returning 404 to user: Instance 3cb9074b-9ac1-4780-ab45-dde1641b83e3 could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:47:05.762764 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-829e80f7-4262-4743-9549-97162fdfd4e4 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 404 len: 111 microversion: 2.1 time: 0.040136 Jun 27 09:47:05.763489 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 507/1038] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:47:05 2022] DELETE /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:47:05.772150 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-581209a3-866e-45b7-a2cf-a28c30f6bff0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:05.773010 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-581209a3-866e-45b7-a2cf-a28c30f6bff0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] [instance: 3cb9074b-9ac1-4780-ab45-dde1641b83e3] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:05.781370 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-581209a3-866e-45b7-a2cf-a28c30f6bff0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:05.782020 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-581209a3-866e-45b7-a2cf-a28c30f6bff0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:05.782897 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-581209a3-866e-45b7-a2cf-a28c30f6bff0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:05.783432 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-581209a3-866e-45b7-a2cf-a28c30f6bff0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:05.805178 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-581209a3-866e-45b7-a2cf-a28c30f6bff0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] HTTP exception thrown: Instance 3cb9074b-9ac1-4780-ab45-dde1641b83e3 could not be found. Jun 27 09:47:05.806766 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-581209a3-866e-45b7-a2cf-a28c30f6bff0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Request method failure captured: Jun 27 09:47:05.806766 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 HTTP/1.1 Jun 27 09:47:05.806766 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:47:05.806766 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:47:05.806766 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:47:05.806766 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:47:05.806766 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:47:05.806766 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:47:05.806766 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:47:05.806766 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:47:05.806766 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXrKJ0sl3youQvE_D_4Ht9u2HFsuYgBgTX6DegLCY_ccCw9Axr0Yw4ikyfrNS517XJKQhYV2ERTEEf23rjHye8Ux6C2rJtHLtDMZ7Wq9N4_MQ2vz1k1OBPJPdykHjY6P2Oh1_dmZ71fy3x7unHYIPtq-CmCyHxPLeZiIJNvhMR3swsA Jun 27 09:47:05.806766 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:47:05.806766 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:47:05.806766 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:47:05.806766 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:47:05.806766 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:47:05.806766 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:47:05.806766 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: 1d5cbd080e204408aa51c29ec2cf1422 Jun 27 09:47:05.806766 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-TestVolumeBootPattern-611261078 Jun 27 09:47:05.806766 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:47:05.806766 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:47:05.809009 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1d5cbd080e204408aa51c29ec2cf1422"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1d5cbd080e204408aa51c29ec2cf1422"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1d5cbd080e204408aa51c29ec2cf1422"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1d5cbd080e204408aa51c29ec2cf1422", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:47:05.809009 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-TestVolumeBootPattern-611261078 Jun 27 09:47:05.809009 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: 1d5cbd080e204408aa51c29ec2cf1422 Jun 27 09:47:05.809009 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-TestVolumeBootPattern-611261078 Jun 27 09:47:05.809009 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-TestVolumeBootPattern-611261078-project Jun 27 09:47:05.809009 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:47:05.809009 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:47:05.809009 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: 2720d45854ab4a61b3b22dd43a523d4b Jun 27 09:47:05.809009 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-TestVolumeBootPattern-611261078-project Jun 27 09:47:05.809009 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: > Jun 27 09:47:05.809009 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Instance 3cb9074b-9ac1-4780-ab45-dde1641b83e3 could not be found. Jun 27 09:47:05.809009 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'id': '3cb9074b-9ac1-4780-ab45-dde1641b83e3'} Jun 27 09:47:05.810139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:47:05.810139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:47:05.810139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:47:05.810139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:47:05.810139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:47:05.810139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:47:05.810139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:47:05.810139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:47:05.810139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:47:05.810139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:47:05.810139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cb9074b-9ac1-4780-ab45-dde1641b83e3 could not be found. Jun 27 09:47:05.810139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:47:05.810139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:47:05.810139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:47:05.810139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:47:05.810139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:47:05.810139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:47:05.810139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:47:05.810139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:47:05.810139 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:47:05.816103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:47:05.816103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:47:05.816103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:47:05.816103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:47:05.816103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:47:05.816103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:47:05.816103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:47:05.816103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cb9074b-9ac1-4780-ab45-dde1641b83e3 could not be found. Jun 27 09:47:05.816103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:47:05.816103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:47:05.816103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:47:05.816103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:47:05.816103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:47:05.816103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:47:05.816103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:47:05.816103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:47:05.816103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cb9074b-9ac1-4780-ab45-dde1641b83e3 could not be found. Jun 27 09:47:05.816103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:47:05.818773 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-581209a3-866e-45b7-a2cf-a28c30f6bff0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Returning 404 to user: Instance 3cb9074b-9ac1-4780-ab45-dde1641b83e3 could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:47:05.818773 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-581209a3-866e-45b7-a2cf-a28c30f6bff0 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3" status: 404 len: 111 microversion: 2.1 time: 0.039727 Jun 27 09:47:05.818773 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 532/1039] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:05 2022] GET /compute/v2.1/servers/3cb9074b-9ac1-4780-ab45-dde1641b83e3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:47:07.479784 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e799dddc-5b6c-42c5-8956-4c4ee4effaa9 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] Calling method '.version_select at 0x7ffa973a1dc0>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:07.595624 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e799dddc-5b6c-42c5-8956-4c4ee4effaa9 tempest-TestVolumeBootPattern-611261078 tempest-TestVolumeBootPattern-611261078-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-205470936" status: 202 len: 0 microversion: 2.1 time: 0.120724 Jun 27 09:47:07.597466 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 508/1040] 10.222.0.64 () {58 vars in 1259 bytes} [Mon Jun 27 09:47:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-205470936 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:47:08.454465 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-33d9c901-75df-40e0-ba5e-7328ddf170a4 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1684366344", "imageRef": "96dfa32c-d52f-4225-8918-743ebc97f4bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63837ba7-06e7-4716-8f4c-6e58bcc433b2"}], "security_groups": [{"name": "tempest-securitygroup--2129333253"}], "key_name": "tempest-keypair-1114211473", "user_data": "}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:47:08.582410 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.network.neutron [None req-33d9c901-75df-40e0-ba5e-7328ddf170a4 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] validate_networks() for [('63837ba7-06e7-4716-8f4c-6e58bcc433b2', None, None, None, None, None)] {{(pid=124869) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 09:47:09.078484 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-33d9c901-75df-40e0-ba5e-7328ddf170a4 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Flavor limits 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 09:47:09.078921 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-33d9c901-75df-40e0-ba5e-7328ddf170a4 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Image limits 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 09:47:09.079726 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-33d9c901-75df-40e0-ba5e-7328ddf170a4 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Flavor pref 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 09:47:09.091739 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-33d9c901-75df-40e0-ba5e-7328ddf170a4 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Image pref 0:0:0 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 09:47:09.091739 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.virt.hardware [None req-33d9c901-75df-40e0-ba5e-7328ddf170a4 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 09:47:09.100174 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-33d9c901-75df-40e0-ba5e-7328ddf170a4 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:09.101184 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-33d9c901-75df-40e0-ba5e-7328ddf170a4 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:09.102884 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-33d9c901-75df-40e0-ba5e-7328ddf170a4 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:09.103574 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-33d9c901-75df-40e0-ba5e-7328ddf170a4 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:09.153042 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-33d9c901-75df-40e0-ba5e-7328ddf170a4 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Getting quotas for project 422340b9e5834d16bff3539c549fc4c1. Resources: {'ram', 'instances', 'cores'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:47:09.157978 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.quota [None req-33d9c901-75df-40e0-ba5e-7328ddf170a4 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Getting quotas for user 222b727863844d2b95a9c7222a56a94c and project 422340b9e5834d16bff3539c549fc4c1. Resources: {'ram', 'instances', 'cores'} {{(pid=124869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:47:09.170702 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-33d9c901-75df-40e0-ba5e-7328ddf170a4 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Going to run 1 instances... {{(pid=124869) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 09:47:09.179903 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-33d9c901-75df-40e0-ba5e-7328ddf170a4 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96dfa32c-d52f-4225-8918-743ebc97f4bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 09:47:09.308100 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-33d9c901-75df-40e0-ba5e-7328ddf170a4 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.857868 Jun 27 09:47:09.314103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 533/1041] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 27 09:47:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 09:47:09.322094 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-aa8d2144-5fb1-4bfc-bcaf-9b93265b3699 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:09.323103 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-aa8d2144-5fb1-4bfc-bcaf-9b93265b3699 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:09.447329 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-aa8d2144-5fb1-4bfc-bcaf-9b93265b3699 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:09.460729 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-aa8d2144-5fb1-4bfc-bcaf-9b93265b3699 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda" status: 200 len: 1238 microversion: 2.1 time: 0.144926 Jun 27 09:47:09.462095 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 509/1042] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:09 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda => generated 1238 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:10.479386 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-d86bb069-c811-45be-9d2f-d48f6aab3f89 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:10.479386 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-d86bb069-c811-45be-9d2f-d48f6aab3f89 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:10.486828 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d86bb069-c811-45be-9d2f-d48f6aab3f89 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:10.487282 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d86bb069-c811-45be-9d2f-d48f6aab3f89 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:10.488105 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d86bb069-c811-45be-9d2f-d48f6aab3f89 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:10.488548 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d86bb069-c811-45be-9d2f-d48f6aab3f89 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:10.574267 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-d86bb069-c811-45be-9d2f-d48f6aab3f89 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:10.586975 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-d86bb069-c811-45be-9d2f-d48f6aab3f89 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda" status: 200 len: 1242 microversion: 2.1 time: 0.109843 Jun 27 09:47:10.586975 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 534/1043] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:10 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda => generated 1242 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:11.604223 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-df900a95-ec31-40cc-98cb-bc5f01cb2ff0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:11.605628 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-df900a95-ec31-40cc-98cb-bc5f01cb2ff0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:11.617606 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-df900a95-ec31-40cc-98cb-bc5f01cb2ff0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:11.619493 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-df900a95-ec31-40cc-98cb-bc5f01cb2ff0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:11.623203 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-df900a95-ec31-40cc-98cb-bc5f01cb2ff0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:11.624168 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-df900a95-ec31-40cc-98cb-bc5f01cb2ff0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:11.946934 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-df900a95-ec31-40cc-98cb-bc5f01cb2ff0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:11.957127 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-df900a95-ec31-40cc-98cb-bc5f01cb2ff0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda" status: 200 len: 1298 microversion: 2.1 time: 0.356337 Jun 27 09:47:11.970396 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 510/1044] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:11 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda => generated 1298 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:12.976514 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-dc4b0420-675c-41ae-ac1d-420576ab9a95 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:12.978380 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-dc4b0420-675c-41ae-ac1d-420576ab9a95 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:13.008863 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dc4b0420-675c-41ae-ac1d-420576ab9a95 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:13.009337 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dc4b0420-675c-41ae-ac1d-420576ab9a95 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:13.010259 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dc4b0420-675c-41ae-ac1d-420576ab9a95 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:13.010706 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dc4b0420-675c-41ae-ac1d-420576ab9a95 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:13.041533 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:47:13.110745 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-dc4b0420-675c-41ae-ac1d-420576ab9a95 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:13.119761 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-dc4b0420-675c-41ae-ac1d-420576ab9a95 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda" status: 200 len: 1296 microversion: 2.1 time: 0.147314 Jun 27 09:47:13.131928 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 535/1045] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:12 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda => generated 1296 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:14.139830 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e54ef5bf-8da2-43b1-b254-e5218d171810 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:14.140608 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e54ef5bf-8da2-43b1-b254-e5218d171810 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:14.149864 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e54ef5bf-8da2-43b1-b254-e5218d171810 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:14.151838 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e54ef5bf-8da2-43b1-b254-e5218d171810 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:14.154021 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e54ef5bf-8da2-43b1-b254-e5218d171810 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:14.156245 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e54ef5bf-8da2-43b1-b254-e5218d171810 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:14.624667 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-e54ef5bf-8da2-43b1-b254-e5218d171810 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:14.632158 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e54ef5bf-8da2-43b1-b254-e5218d171810 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda" status: 200 len: 1364 microversion: 2.1 time: 0.498255 Jun 27 09:47:14.632752 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 511/1046] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:14 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda => generated 1364 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:15.649465 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-0e91a062-30f9-45b0-b2d9-f0a28eb27373 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:15.651381 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-0e91a062-30f9-45b0-b2d9-f0a28eb27373 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:15.659368 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0e91a062-30f9-45b0-b2d9-f0a28eb27373 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:15.660187 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0e91a062-30f9-45b0-b2d9-f0a28eb27373 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:15.661073 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0e91a062-30f9-45b0-b2d9-f0a28eb27373 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:15.661579 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0e91a062-30f9-45b0-b2d9-f0a28eb27373 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:15.837978 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-0e91a062-30f9-45b0-b2d9-f0a28eb27373 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:15.844218 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-0e91a062-30f9-45b0-b2d9-f0a28eb27373 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda" status: 200 len: 1364 microversion: 2.1 time: 0.198976 Jun 27 09:47:15.854798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 536/1047] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:15 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:15.892785 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-b63cae0f-ac2f-4921-9106-98baad4aec41 req-f7ce37c3-cc41-4598-ac0a-a641913a88b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95087d59-289d-459e-bb2d-0f57e11a0dda", "tag": "34935d13-04a1-4313-a5d2-6a9de448f426"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:47:15.911420 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-b63cae0f-ac2f-4921-9106-98baad4aec41 req-f7ce37c3-cc41-4598-ac0a-a641913a88b5 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:15.911420 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-b63cae0f-ac2f-4921-9106-98baad4aec41 req-f7ce37c3-cc41-4598-ac0a-a641913a88b5 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:15.932538 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-b63cae0f-ac2f-4921-9106-98baad4aec41 req-f7ce37c3-cc41-4598-ac0a-a641913a88b5 service nova] Creating event network-changed:34935d13-04a1-4313-a5d2-6a9de448f426 for instance 95087d59-289d-459e-bb2d-0f57e11a0dda on hv-cinder-84773 Jun 27 09:47:15.938359 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-b63cae0f-ac2f-4921-9106-98baad4aec41 req-f7ce37c3-cc41-4598-ac0a-a641913a88b5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053056 Jun 27 09:47:15.939404 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 537/1048] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:47:15.984538 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a199501b-3914-4b75-94b4-0eff0f865a21 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Action: 'create', calling method: .version_select at 0x7ffa97468ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1915703540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEML+mEEtyqtbZG3ojvUMz5zvj4uYsG0fSGG9fQ2uhPAeg9iXr7mr/zrQJl29rkkzxDevpsJtoSYCR0tZDWc1EVpZeBFm4ABg5oq8WwzQEQMG9+a6GC/Ls/8s0tCClLswQ=="}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:47:16.005155 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-a199501b-3914-4b75-94b4-0eff0f865a21 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Getting quotas for project cf6354961eda4916a8324508b45a98d5. Resources: {'key_pairs'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:47:16.010479 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-a199501b-3914-4b75-94b4-0eff0f865a21 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Getting quotas for user ca82a093a28f40f8a2bfc1f93df03493 and project cf6354961eda4916a8324508b45a98d5. Resources: {'key_pairs'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:47:16.128638 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-a199501b-3914-4b75-94b4-0eff0f865a21 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.415525 Jun 27 09:47:16.129551 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 512/1049] 10.222.0.64 () {60 vars in 1158 bytes} [Mon Jun 27 09:47:15 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:47:16.862286 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-6f620a73-d63e-4850-bb72-1fcec6d26405 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:16.866899 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-6f620a73-d63e-4850-bb72-1fcec6d26405 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:16.873520 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6f620a73-d63e-4850-bb72-1fcec6d26405 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:16.874330 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6f620a73-d63e-4850-bb72-1fcec6d26405 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:16.874792 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6f620a73-d63e-4850-bb72-1fcec6d26405 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:16.875236 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6f620a73-d63e-4850-bb72-1fcec6d26405 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:17.057089 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6f620a73-d63e-4850-bb72-1fcec6d26405 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:17.066197 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-6f620a73-d63e-4850-bb72-1fcec6d26405 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda" status: 200 len: 1364 microversion: 2.1 time: 0.208792 Jun 27 09:47:17.067081 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 538/1050] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:16 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:18.084144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-286fc7bc-eadf-49e0-85ea-aa8e021a468c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:18.084785 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-286fc7bc-eadf-49e0-85ea-aa8e021a468c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:18.096599 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-286fc7bc-eadf-49e0-85ea-aa8e021a468c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:18.097070 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-286fc7bc-eadf-49e0-85ea-aa8e021a468c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:18.097840 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-286fc7bc-eadf-49e0-85ea-aa8e021a468c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:18.098279 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-286fc7bc-eadf-49e0-85ea-aa8e021a468c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:18.283001 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-286fc7bc-eadf-49e0-85ea-aa8e021a468c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:18.305594 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-286fc7bc-eadf-49e0-85ea-aa8e021a468c tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda" status: 200 len: 1364 microversion: 2.1 time: 0.225776 Jun 27 09:47:18.314873 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 513/1051] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:18 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:47:19.326323 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-ebfd8bb3-2335-42a9-85d9-31717ba1a8a1 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:19.326980 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-ebfd8bb3-2335-42a9-85d9-31717ba1a8a1 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:19.336474 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell0:SELECT=2 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:47:19.342838 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell0:SELECT=10 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:47:19.342838 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ebfd8bb3-2335-42a9-85d9-31717ba1a8a1 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:19.342838 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ebfd8bb3-2335-42a9-85d9-31717ba1a8a1 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:19.342838 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ebfd8bb3-2335-42a9-85d9-31717ba1a8a1 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:19.343961 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-ebfd8bb3-2335-42a9-85d9-31717ba1a8a1 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:19.526455 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-ebfd8bb3-2335-42a9-85d9-31717ba1a8a1 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:19.539031 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-ebfd8bb3-2335-42a9-85d9-31717ba1a8a1 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda" status: 200 len: 1364 microversion: 2.1 time: 0.220399 Jun 27 09:47:19.540375 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 539/1052] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:19 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:20.556104 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-cb01d002-dc05-4267-b9d2-c5a895c56fb0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:20.556717 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-cb01d002-dc05-4267-b9d2-c5a895c56fb0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:20.563144 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cb01d002-dc05-4267-b9d2-c5a895c56fb0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:20.563621 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cb01d002-dc05-4267-b9d2-c5a895c56fb0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:20.564401 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cb01d002-dc05-4267-b9d2-c5a895c56fb0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:20.564848 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cb01d002-dc05-4267-b9d2-c5a895c56fb0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:20.707135 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-cb01d002-dc05-4267-b9d2-c5a895c56fb0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:20.715178 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-cb01d002-dc05-4267-b9d2-c5a895c56fb0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda" status: 200 len: 1364 microversion: 2.1 time: 0.162889 Jun 27 09:47:20.715882 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 514/1053] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:20 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:21.732851 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-3d99119e-fa49-4381-aa3e-80551879b91f tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:21.733574 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-3d99119e-fa49-4381-aa3e-80551879b91f tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:21.740873 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3d99119e-fa49-4381-aa3e-80551879b91f tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:21.741320 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3d99119e-fa49-4381-aa3e-80551879b91f tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:21.742237 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3d99119e-fa49-4381-aa3e-80551879b91f tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:21.742679 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3d99119e-fa49-4381-aa3e-80551879b91f tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:21.896181 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-3d99119e-fa49-4381-aa3e-80551879b91f tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:21.904874 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-3d99119e-fa49-4381-aa3e-80551879b91f tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda" status: 200 len: 1364 microversion: 2.1 time: 0.176348 Jun 27 09:47:21.905472 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 540/1054] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:21 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:22.701414 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-34ce01a2-c158-4ef9-87b2-60a80c2b56fc req-5e9ec4db-6a77-4310-9e24-310273fdea40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95087d59-289d-459e-bb2d-0f57e11a0dda", "name": "network-vif-plugged", "status": "completed", "tag": "34935d13-04a1-4313-a5d2-6a9de448f426"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:47:22.705035 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:47:22.710182 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-34ce01a2-c158-4ef9-87b2-60a80c2b56fc req-5e9ec4db-6a77-4310-9e24-310273fdea40 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:22.714626 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-34ce01a2-c158-4ef9-87b2-60a80c2b56fc req-5e9ec4db-6a77-4310-9e24-310273fdea40 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:22.721349 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-34ce01a2-c158-4ef9-87b2-60a80c2b56fc req-5e9ec4db-6a77-4310-9e24-310273fdea40 service nova] Creating event network-vif-plugged:34935d13-04a1-4313-a5d2-6a9de448f426 for instance 95087d59-289d-459e-bb2d-0f57e11a0dda on hv-cinder-84773 Jun 27 09:47:22.726370 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-34ce01a2-c158-4ef9-87b2-60a80c2b56fc req-5e9ec4db-6a77-4310-9e24-310273fdea40 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213989 Jun 27 09:47:22.726940 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 515/1055] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:47:22.923012 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-2446c2b4-41a5-45b6-a38a-03c4a1b603a0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:22.923583 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-2446c2b4-41a5-45b6-a38a-03c4a1b603a0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:22.925829 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:47:22.930671 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2446c2b4-41a5-45b6-a38a-03c4a1b603a0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:22.931117 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2446c2b4-41a5-45b6-a38a-03c4a1b603a0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:22.931914 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2446c2b4-41a5-45b6-a38a-03c4a1b603a0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:22.932352 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-2446c2b4-41a5-45b6-a38a-03c4a1b603a0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:23.064518 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-2446c2b4-41a5-45b6-a38a-03c4a1b603a0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:23.077359 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-2446c2b4-41a5-45b6-a38a-03c4a1b603a0 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda" status: 200 len: 1364 microversion: 2.1 time: 0.158494 Jun 27 09:47:23.077953 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 541/1056] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:22 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:24.096089 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e0f46669-e2b0-4fdf-995c-6db78e54c235 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:24.096721 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e0f46669-e2b0-4fdf-995c-6db78e54c235 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:24.103482 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e0f46669-e2b0-4fdf-995c-6db78e54c235 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:24.103974 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e0f46669-e2b0-4fdf-995c-6db78e54c235 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:24.105340 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e0f46669-e2b0-4fdf-995c-6db78e54c235 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:24.105782 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e0f46669-e2b0-4fdf-995c-6db78e54c235 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:24.109866 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:47:24.239070 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-e0f46669-e2b0-4fdf-995c-6db78e54c235 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:24.248506 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e0f46669-e2b0-4fdf-995c-6db78e54c235 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda" status: 200 len: 1364 microversion: 2.1 time: 0.157467 Jun 27 09:47:24.249379 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 516/1057] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:24 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:25.266898 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-0c705b3c-1a6c-4180-98b9-a2094e5767cc tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:25.267711 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-0c705b3c-1a6c-4180-98b9-a2094e5767cc tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:25.275346 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0c705b3c-1a6c-4180-98b9-a2094e5767cc tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:25.275854 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0c705b3c-1a6c-4180-98b9-a2094e5767cc tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:25.276648 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0c705b3c-1a6c-4180-98b9-a2094e5767cc tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:25.277087 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-0c705b3c-1a6c-4180-98b9-a2094e5767cc tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:25.405319 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-0c705b3c-1a6c-4180-98b9-a2094e5767cc tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:25.416545 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-0c705b3c-1a6c-4180-98b9-a2094e5767cc tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda" status: 200 len: 1551 microversion: 2.1 time: 0.151822 Jun 27 09:47:25.416545 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 542/1058] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:25 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda => generated 1551 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:25.430406 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e2c684a6-e35b-4604-be7d-8b191f069d88 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:25.430893 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e2c684a6-e35b-4604-be7d-8b191f069d88 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:25.438998 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e2c684a6-e35b-4604-be7d-8b191f069d88 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:25.439447 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e2c684a6-e35b-4604-be7d-8b191f069d88 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:25.440280 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e2c684a6-e35b-4604-be7d-8b191f069d88 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:25.440713 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e2c684a6-e35b-4604-be7d-8b191f069d88 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:25.519916 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e2c684a6-e35b-4604-be7d-8b191f069d88 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093337 Jun 27 09:47:25.520509 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 517/1059] 10.222.0.64 () {58 vars in 1274 bytes} [Mon Jun 27 09:47:25 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:47:26.776651 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-93be5011-47ea-4b16-b099-937c9c9b8ae5 req-49bfac4b-ac31-428c-b590-d1932fbdd1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95087d59-289d-459e-bb2d-0f57e11a0dda", "tag": "34935d13-04a1-4313-a5d2-6a9de448f426"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:47:26.785872 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-93be5011-47ea-4b16-b099-937c9c9b8ae5 req-49bfac4b-ac31-428c-b590-d1932fbdd1e2 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:26.786613 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-93be5011-47ea-4b16-b099-937c9c9b8ae5 req-49bfac4b-ac31-428c-b590-d1932fbdd1e2 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:26.800429 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-93be5011-47ea-4b16-b099-937c9c9b8ae5 req-49bfac4b-ac31-428c-b590-d1932fbdd1e2 service nova] Creating event network-changed:34935d13-04a1-4313-a5d2-6a9de448f426 for instance 95087d59-289d-459e-bb2d-0f57e11a0dda on hv-cinder-84773 Jun 27 09:47:26.805617 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-93be5011-47ea-4b16-b099-937c9c9b8ae5 req-49bfac4b-ac31-428c-b590-d1932fbdd1e2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032642 Jun 27 09:47:26.806292 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 543/1060] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:47:34.906133 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=6 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:47:34.911393 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-12f516e8-fff8-4c85-a559-543f837ac375 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-489014840", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1915703540", "security_groups": [{"name": "tempest-secgroup-smoke-848239221"}], "networks": [{"uuid": "e4924a4a-6de5-4807-86e8-d54106b11160"}], "block_device_mapping_v2": [{"uuid": "60175718-c8ba-470e-bdc2-aa61267e22e4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:47:35.020566 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.network.neutron [None req-12f516e8-fff8-4c85-a559-543f837ac375 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] validate_networks() for [('e4924a4a-6de5-4807-86e8-d54106b11160', None, None, None, None, None)] {{(pid=124870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 09:47:35.472001 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=9 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:47:35.482867 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-12f516e8-fff8-4c85-a559-543f837ac375 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Flavor limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 09:47:35.483285 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-12f516e8-fff8-4c85-a559-543f837ac375 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Image limits 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 09:47:35.483797 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-12f516e8-fff8-4c85-a559-543f837ac375 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Flavor pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 09:47:35.484209 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-12f516e8-fff8-4c85-a559-543f837ac375 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Image pref 0:0:0 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 09:47:35.484632 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.virt.hardware [None req-12f516e8-fff8-4c85-a559-543f837ac375 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 09:47:35.494241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-12f516e8-fff8-4c85-a559-543f837ac375 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:35.495752 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-12f516e8-fff8-4c85-a559-543f837ac375 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:35.495752 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-12f516e8-fff8-4c85-a559-543f837ac375 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:35.496007 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-12f516e8-fff8-4c85-a559-543f837ac375 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:35.512016 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-12f516e8-fff8-4c85-a559-543f837ac375 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Getting quotas for project cf6354961eda4916a8324508b45a98d5. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 09:47:35.515930 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.quota [None req-12f516e8-fff8-4c85-a559-543f837ac375 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Getting quotas for user ca82a093a28f40f8a2bfc1f93df03493 and project cf6354961eda4916a8324508b45a98d5. Resources: {'ram', 'instances', 'cores'} {{(pid=124870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 09:47:35.571784 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-12f516e8-fff8-4c85-a559-543f837ac375 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Going to run 1 instances... {{(pid=124870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 09:47:35.573898 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-12f516e8-fff8-4c85-a559-543f837ac375 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='60175718-c8ba-470e-bdc2-aa61267e22e4',volume_size=None,volume_type=None)] {{(pid=124870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 09:47:35.962388 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-12f516e8-fff8-4c85-a559-543f837ac375 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.056781 Jun 27 09:47:35.963682 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 518/1061] 10.222.0.64 () {60 vars in 1146 bytes} [Mon Jun 27 09:47:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 09:47:35.974992 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-01dcc1c1-2bff-4d8c-95e7-4ff18fbbb395 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:35.975842 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-01dcc1c1-2bff-4d8c-95e7-4ff18fbbb395 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:36.033605 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-01dcc1c1-2bff-4d8c-95e7-4ff18fbbb395 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:36.041138 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-01dcc1c1-2bff-4d8c-95e7-4ff18fbbb395 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1088 microversion: 2.1 time: 0.071218 Jun 27 09:47:36.041711 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 544/1062] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:35 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:37.058436 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-f0ef1a05-cdc5-49ca-b41c-c1f10bf8dd84 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:37.059000 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-f0ef1a05-cdc5-49ca-b41c-c1f10bf8dd84 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:37.065781 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f0ef1a05-cdc5-49ca-b41c-c1f10bf8dd84 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:37.066230 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f0ef1a05-cdc5-49ca-b41c-c1f10bf8dd84 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:37.067005 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f0ef1a05-cdc5-49ca-b41c-c1f10bf8dd84 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:37.067441 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f0ef1a05-cdc5-49ca-b41c-c1f10bf8dd84 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:37.134620 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-f0ef1a05-cdc5-49ca-b41c-c1f10bf8dd84 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:37.144040 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-f0ef1a05-cdc5-49ca-b41c-c1f10bf8dd84 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1138 microversion: 2.1 time: 0.090105 Jun 27 09:47:37.144614 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 519/1063] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:37 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1138 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:38.161448 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-62683e0f-dc2f-4e29-82c6-921c2a86de76 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:38.162055 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-62683e0f-dc2f-4e29-82c6-921c2a86de76 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:38.165052 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=42 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:47:38.169930 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-62683e0f-dc2f-4e29-82c6-921c2a86de76 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:38.170380 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-62683e0f-dc2f-4e29-82c6-921c2a86de76 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:38.171150 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-62683e0f-dc2f-4e29-82c6-921c2a86de76 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:38.172450 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-62683e0f-dc2f-4e29-82c6-921c2a86de76 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:38.234675 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-62683e0f-dc2f-4e29-82c6-921c2a86de76 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:38.242120 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-62683e0f-dc2f-4e29-82c6-921c2a86de76 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1194 microversion: 2.1 time: 0.084495 Jun 27 09:47:38.242696 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 545/1064] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:38 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:39.259809 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-257c11d1-1795-4d03-a279-cab792bcd277 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:39.260650 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-257c11d1-1795-4d03-a279-cab792bcd277 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:39.267813 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-257c11d1-1795-4d03-a279-cab792bcd277 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:39.268364 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-257c11d1-1795-4d03-a279-cab792bcd277 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:39.269206 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-257c11d1-1795-4d03-a279-cab792bcd277 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:39.269717 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-257c11d1-1795-4d03-a279-cab792bcd277 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:39.477212 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-257c11d1-1795-4d03-a279-cab792bcd277 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:39.486777 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-257c11d1-1795-4d03-a279-cab792bcd277 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1271 microversion: 2.1 time: 0.230788 Jun 27 09:47:39.487339 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 520/1065] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:39 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1271 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:39.990241 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-e65fb034-e390-4de5-89df-e99464225f0e req-57ec03ff-a561-439c-bd29-40a8d710355a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "526bfd18-438f-40ca-a0a2-23590d5712c2", "tag": "9d599bda-d36b-48fc-9462-bc44070afb0c"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:47:40.000552 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-e65fb034-e390-4de5-89df-e99464225f0e req-57ec03ff-a561-439c-bd29-40a8d710355a service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:40.003699 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-e65fb034-e390-4de5-89df-e99464225f0e req-57ec03ff-a561-439c-bd29-40a8d710355a service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:40.018400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-e65fb034-e390-4de5-89df-e99464225f0e req-57ec03ff-a561-439c-bd29-40a8d710355a service nova] Creating event network-changed:9d599bda-d36b-48fc-9462-bc44070afb0c for instance 526bfd18-438f-40ca-a0a2-23590d5712c2 on hv-cinder-84773 Jun 27 09:47:40.023459 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-e65fb034-e390-4de5-89df-e99464225f0e req-57ec03ff-a561-439c-bd29-40a8d710355a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039472 Jun 27 09:47:40.025244 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 546/1066] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:47:40.503656 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-689a4d2e-e53f-44a6-90ec-293ecf25b064 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:40.504276 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-689a4d2e-e53f-44a6-90ec-293ecf25b064 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:40.510639 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-689a4d2e-e53f-44a6-90ec-293ecf25b064 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:40.511092 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-689a4d2e-e53f-44a6-90ec-293ecf25b064 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:40.511990 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-689a4d2e-e53f-44a6-90ec-293ecf25b064 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:40.512433 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-689a4d2e-e53f-44a6-90ec-293ecf25b064 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:40.719891 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-689a4d2e-e53f-44a6-90ec-293ecf25b064 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:40.727320 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-689a4d2e-e53f-44a6-90ec-293ecf25b064 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1259 microversion: 2.1 time: 0.227498 Jun 27 09:47:40.727858 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 521/1067] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:40 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:41.749105 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-60f505e9-f4aa-4a62-a8af-f3f9c01d618d tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:41.749831 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-60f505e9-f4aa-4a62-a8af-f3f9c01d618d tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:41.756013 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-60f505e9-f4aa-4a62-a8af-f3f9c01d618d tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:41.756460 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-60f505e9-f4aa-4a62-a8af-f3f9c01d618d tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:41.757221 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-60f505e9-f4aa-4a62-a8af-f3f9c01d618d tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:41.757658 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-60f505e9-f4aa-4a62-a8af-f3f9c01d618d tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:41.894813 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-60f505e9-f4aa-4a62-a8af-f3f9c01d618d tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:41.902133 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-60f505e9-f4aa-4a62-a8af-f3f9c01d618d tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1259 microversion: 2.1 time: 0.157656 Jun 27 09:47:41.902685 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 547/1068] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:41 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:42.918701 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-3152b7d8-d456-4143-b759-a9fb85b39702 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:42.919784 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-3152b7d8-d456-4143-b759-a9fb85b39702 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:42.926387 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3152b7d8-d456-4143-b759-a9fb85b39702 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:42.926831 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3152b7d8-d456-4143-b759-a9fb85b39702 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:42.927610 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3152b7d8-d456-4143-b759-a9fb85b39702 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:42.928044 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3152b7d8-d456-4143-b759-a9fb85b39702 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:43.055639 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-3152b7d8-d456-4143-b759-a9fb85b39702 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:43.063802 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-3152b7d8-d456-4143-b759-a9fb85b39702 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1259 microversion: 2.1 time: 0.148991 Jun 27 09:47:43.064371 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 522/1069] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:42 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:44.081355 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-55909681-7e0b-4d19-82c7-0a9edd70bd86 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:44.081894 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-55909681-7e0b-4d19-82c7-0a9edd70bd86 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:44.088476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-55909681-7e0b-4d19-82c7-0a9edd70bd86 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:44.088926 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-55909681-7e0b-4d19-82c7-0a9edd70bd86 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:44.089722 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-55909681-7e0b-4d19-82c7-0a9edd70bd86 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:44.090170 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-55909681-7e0b-4d19-82c7-0a9edd70bd86 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:44.220607 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-55909681-7e0b-4d19-82c7-0a9edd70bd86 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:44.228043 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-55909681-7e0b-4d19-82c7-0a9edd70bd86 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1259 microversion: 2.1 time: 0.150663 Jun 27 09:47:44.228602 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 548/1070] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:44 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:45.244366 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-6c1a76fa-6add-4a81-be6b-1f580498e58c tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:45.244996 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-6c1a76fa-6add-4a81-be6b-1f580498e58c tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:45.251468 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6c1a76fa-6add-4a81-be6b-1f580498e58c tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:45.251942 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6c1a76fa-6add-4a81-be6b-1f580498e58c tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:45.252699 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6c1a76fa-6add-4a81-be6b-1f580498e58c tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:45.253162 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6c1a76fa-6add-4a81-be6b-1f580498e58c tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:45.384675 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-6c1a76fa-6add-4a81-be6b-1f580498e58c tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:45.392626 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-6c1a76fa-6add-4a81-be6b-1f580498e58c tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1259 microversion: 2.1 time: 0.152260 Jun 27 09:47:45.393194 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 523/1071] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:45 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:46.409880 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-75c47478-2d41-4a02-8b4e-5b4d2e8a7791 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:46.418446 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-75c47478-2d41-4a02-8b4e-5b4d2e8a7791 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:46.418446 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell0:SELECT=2 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:47:46.418446 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-75c47478-2d41-4a02-8b4e-5b4d2e8a7791 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:46.418446 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-75c47478-2d41-4a02-8b4e-5b4d2e8a7791 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:46.418905 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-75c47478-2d41-4a02-8b4e-5b4d2e8a7791 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:46.419945 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-75c47478-2d41-4a02-8b4e-5b4d2e8a7791 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:46.548743 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-75c47478-2d41-4a02-8b4e-5b4d2e8a7791 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:46.556159 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-75c47478-2d41-4a02-8b4e-5b4d2e8a7791 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1259 microversion: 2.1 time: 0.150050 Jun 27 09:47:46.556721 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 549/1072] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:46 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:47.572699 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-63b26185-5664-42c4-a14c-86602e991a63 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:47.573312 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-63b26185-5664-42c4-a14c-86602e991a63 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:47.575152 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=2 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:47:47.575828 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell0:SELECT=6 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:47:47.581091 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-63b26185-5664-42c4-a14c-86602e991a63 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:47.586919 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-63b26185-5664-42c4-a14c-86602e991a63 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:47.586919 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-63b26185-5664-42c4-a14c-86602e991a63 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:47.586919 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-63b26185-5664-42c4-a14c-86602e991a63 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:47.709936 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-63b26185-5664-42c4-a14c-86602e991a63 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:47.717220 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-63b26185-5664-42c4-a14c-86602e991a63 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1259 microversion: 2.1 time: 0.148378 Jun 27 09:47:47.718276 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 524/1073] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:47 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:48.734137 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f4409232-0592-4fad-9bdf-1b22a6a5d60b tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:48.734753 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-f4409232-0592-4fad-9bdf-1b22a6a5d60b tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:48.741228 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f4409232-0592-4fad-9bdf-1b22a6a5d60b tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:48.741680 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f4409232-0592-4fad-9bdf-1b22a6a5d60b tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:48.742447 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f4409232-0592-4fad-9bdf-1b22a6a5d60b tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:48.742895 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-f4409232-0592-4fad-9bdf-1b22a6a5d60b tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:48.874476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-f4409232-0592-4fad-9bdf-1b22a6a5d60b tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:48.881871 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-f4409232-0592-4fad-9bdf-1b22a6a5d60b tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1259 microversion: 2.1 time: 0.151623 Jun 27 09:47:48.882455 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 550/1074] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:48 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:49.898169 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-3ea3a7b2-6ca1-409d-961d-53775d57a534 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:49.898787 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-3ea3a7b2-6ca1-409d-961d-53775d57a534 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:49.905805 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3ea3a7b2-6ca1-409d-961d-53775d57a534 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:49.906258 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3ea3a7b2-6ca1-409d-961d-53775d57a534 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:49.907031 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3ea3a7b2-6ca1-409d-961d-53775d57a534 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:49.907472 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3ea3a7b2-6ca1-409d-961d-53775d57a534 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:50.041332 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-3ea3a7b2-6ca1-409d-961d-53775d57a534 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:50.049733 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-3ea3a7b2-6ca1-409d-961d-53775d57a534 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1259 microversion: 2.1 time: 0.155464 Jun 27 09:47:50.050306 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 525/1075] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:49 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:50.680197 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-18dd3053-4119-48ab-a6ee-788c3362e309 req-501c2a97-3e96-4b87-8a05-db432037d038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "526bfd18-438f-40ca-a0a2-23590d5712c2", "name": "network-vif-plugged", "status": "completed", "tag": "9d599bda-d36b-48fc-9462-bc44070afb0c"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:47:50.689179 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-18dd3053-4119-48ab-a6ee-788c3362e309 req-501c2a97-3e96-4b87-8a05-db432037d038 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:50.692454 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-18dd3053-4119-48ab-a6ee-788c3362e309 req-501c2a97-3e96-4b87-8a05-db432037d038 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:50.700275 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-18dd3053-4119-48ab-a6ee-788c3362e309 req-501c2a97-3e96-4b87-8a05-db432037d038 service nova] Creating event network-vif-plugged:9d599bda-d36b-48fc-9462-bc44070afb0c for instance 526bfd18-438f-40ca-a0a2-23590d5712c2 on hv-cinder-84773 Jun 27 09:47:50.705967 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-18dd3053-4119-48ab-a6ee-788c3362e309 req-501c2a97-3e96-4b87-8a05-db432037d038 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029471 Jun 27 09:47:50.706551 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 551/1076] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:47:51.066696 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-6c956d17-2e9e-47fd-98c2-44d0705eb232 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:51.067338 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-6c956d17-2e9e-47fd-98c2-44d0705eb232 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:51.073703 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6c956d17-2e9e-47fd-98c2-44d0705eb232 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:51.074152 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6c956d17-2e9e-47fd-98c2-44d0705eb232 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:51.074991 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6c956d17-2e9e-47fd-98c2-44d0705eb232 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:51.075398 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6c956d17-2e9e-47fd-98c2-44d0705eb232 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:51.204389 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-6c956d17-2e9e-47fd-98c2-44d0705eb232 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:51.211646 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-6c956d17-2e9e-47fd-98c2-44d0705eb232 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1259 microversion: 2.1 time: 0.148750 Jun 27 09:47:51.212193 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 526/1077] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:51 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:52.229421 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-75ed27b5-8bfc-41c3-9b31-e13d8080eb43 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:52.230039 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-75ed27b5-8bfc-41c3-9b31-e13d8080eb43 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:52.236204 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-75ed27b5-8bfc-41c3-9b31-e13d8080eb43 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:52.236646 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-75ed27b5-8bfc-41c3-9b31-e13d8080eb43 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:52.237399 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-75ed27b5-8bfc-41c3-9b31-e13d8080eb43 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:52.237904 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-75ed27b5-8bfc-41c3-9b31-e13d8080eb43 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:52.367293 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-75ed27b5-8bfc-41c3-9b31-e13d8080eb43 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:52.375225 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-75ed27b5-8bfc-41c3-9b31-e13d8080eb43 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1259 microversion: 2.1 time: 0.150584 Jun 27 09:47:52.375825 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 552/1078] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:52 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:53.391851 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-7e4cebb3-3249-4275-8e63-bf0d39ff7db9 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:53.392472 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-7e4cebb3-3249-4275-8e63-bf0d39ff7db9 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:53.398911 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7e4cebb3-3249-4275-8e63-bf0d39ff7db9 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:53.399367 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7e4cebb3-3249-4275-8e63-bf0d39ff7db9 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:53.400169 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7e4cebb3-3249-4275-8e63-bf0d39ff7db9 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:53.400617 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-7e4cebb3-3249-4275-8e63-bf0d39ff7db9 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:53.533613 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-7e4cebb3-3249-4275-8e63-bf0d39ff7db9 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:53.541175 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-7e4cebb3-3249-4275-8e63-bf0d39ff7db9 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1443 microversion: 2.1 time: 0.153702 Jun 27 09:47:53.541733 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 527/1079] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:53 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:53.557013 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-e6e33842-d668-40ea-863b-6dbe0b334f45 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:47:53.558279 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-e6e33842-d668-40ea-863b-6dbe0b334f45 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:47:53.564636 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e6e33842-d668-40ea-863b-6dbe0b334f45 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:53.565089 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e6e33842-d668-40ea-863b-6dbe0b334f45 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:53.565860 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e6e33842-d668-40ea-863b-6dbe0b334f45 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:53.566297 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-e6e33842-d668-40ea-863b-6dbe0b334f45 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:53.701891 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-e6e33842-d668-40ea-863b-6dbe0b334f45 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:47:53.710047 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-e6e33842-d668-40ea-863b-6dbe0b334f45 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1443 microversion: 2.1 time: 0.156833 Jun 27 09:47:53.710593 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 553/1080] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:47:53 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:47:55.942783 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [req-71ea5179-cbb9-46f7-a579-a02e6fe71898 req-7f3883b7-01e4-4bec-a14e-6284ac9d5f78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "526bfd18-438f-40ca-a0a2-23590d5712c2", "tag": "9d599bda-d36b-48fc-9462-bc44070afb0c"}]} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:47:55.950820 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-71ea5179-cbb9-46f7-a579-a02e6fe71898 req-7f3883b7-01e4-4bec-a14e-6284ac9d5f78 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:47:55.951267 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [req-71ea5179-cbb9-46f7-a579-a02e6fe71898 req-7f3883b7-01e4-4bec-a14e-6284ac9d5f78 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:47:55.962668 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.compute.server_external_events [req-71ea5179-cbb9-46f7-a579-a02e6fe71898 req-7f3883b7-01e4-4bec-a14e-6284ac9d5f78 service nova] Creating event network-changed:9d599bda-d36b-48fc-9462-bc44070afb0c for instance 526bfd18-438f-40ca-a0a2-23590d5712c2 on hv-cinder-84773 Jun 27 09:47:55.967668 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [req-71ea5179-cbb9-46f7-a579-a02e6fe71898 req-7f3883b7-01e4-4bec-a14e-6284ac9d5f78 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089376 Jun 27 09:47:55.968239 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 528/1081] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:48:02.945871 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-381e5130-85ce-47af-9f98-f558e8697b58 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:48:02.946381 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-381e5130-85ce-47af-9f98-f558e8697b58 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:48:02.948952 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=28 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:48:02.954199 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-381e5130-85ce-47af-9f98-f558e8697b58 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:02.954651 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-381e5130-85ce-47af-9f98-f558e8697b58 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:02.955412 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-381e5130-85ce-47af-9f98-f558e8697b58 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:02.955878 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-381e5130-85ce-47af-9f98-f558e8697b58 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:02.978937 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-381e5130-85ce-47af-9f98-f558e8697b58 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/ips" status: 200 len: 146 microversion: 2.1 time: 0.036984 Jun 27 09:48:02.979492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 554/1082] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jun 27 09:48:02 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:48:04.549407 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-cbc171df-5fa7-485b-be6f-dae1f9cedc19 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36a86b52-eff7-4088-bab4-856e989d918a"}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:48:04.550586 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-cbc171df-5fa7-485b-be6f-dae1f9cedc19 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:48:04.556860 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cbc171df-5fa7-485b-be6f-dae1f9cedc19 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:04.557361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cbc171df-5fa7-485b-be6f-dae1f9cedc19 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:04.558120 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cbc171df-5fa7-485b-be6f-dae1f9cedc19 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:04.558553 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-cbc171df-5fa7-485b-be6f-dae1f9cedc19 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:05.481032 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-cbc171df-5fa7-485b-be6f-dae1f9cedc19 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "POST /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.936801 Jun 27 09:48:05.481645 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 529/1083] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 27 09:48:04 2022] POST /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/os-volume_attachments => generated 194 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:48:12.954210 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-3c6a370a-a492-466d-92dc-068d970bbcfa tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:48:12.955166 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-3c6a370a-a492-466d-92dc-068d970bbcfa tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:48:12.961378 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3c6a370a-a492-466d-92dc-068d970bbcfa tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:12.961824 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3c6a370a-a492-466d-92dc-068d970bbcfa tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:12.962587 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3c6a370a-a492-466d-92dc-068d970bbcfa tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:12.963025 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3c6a370a-a492-466d-92dc-068d970bbcfa tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:12.966618 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=51 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:48:12.991810 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-3c6a370a-a492-466d-92dc-068d970bbcfa tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042375 Jun 27 09:48:12.992357 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 555/1084] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 27 09:48:12 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:48:13.003637 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-db44d88e-bd9c-4b6c-863f-949bfebf3634 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:48:13.004220 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-db44d88e-bd9c-4b6c-863f-949bfebf3634 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:48:13.006148 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:48:13.011096 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-db44d88e-bd9c-4b6c-863f-949bfebf3634 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:13.011565 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-db44d88e-bd9c-4b6c-863f-949bfebf3634 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:13.012334 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-db44d88e-bd9c-4b6c-863f-949bfebf3634 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:13.012771 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-db44d88e-bd9c-4b6c-863f-949bfebf3634 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:13.017050 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:48:13.042428 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-db44d88e-bd9c-4b6c-863f-949bfebf3634 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/os-volume_attachments/36a86b52-eff7-4088-bab4-856e989d918a" status: 200 len: 194 microversion: 2.1 time: 0.044044 Jun 27 09:48:13.043005 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 530/1085] 10.222.0.64 () {58 vars in 1412 bytes} [Mon Jun 27 09:48:12 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/os-volume_attachments/36a86b52-eff7-4088-bab4-856e989d918a => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:48:14.637500 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-7f3d72fd-e51c-45d4-9f01-75066586a305 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ee32f2a-4de0-4453-98e1-557cb929dd55"}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:48:14.638552 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-7f3d72fd-e51c-45d4-9f01-75066586a305 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:48:14.646225 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7f3d72fd-e51c-45d4-9f01-75066586a305 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:14.646669 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7f3d72fd-e51c-45d4-9f01-75066586a305 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:14.647426 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7f3d72fd-e51c-45d4-9f01-75066586a305 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:14.647911 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-7f3d72fd-e51c-45d4-9f01-75066586a305 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:15.258215 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-7f3d72fd-e51c-45d4-9f01-75066586a305 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "POST /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.624439 Jun 27 09:48:15.258822 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 556/1086] 10.222.0.64 () {60 vars in 1322 bytes} [Mon Jun 27 09:48:14 2022] POST /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/os-volume_attachments => generated 194 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:48:22.734835 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-ac454130-ada0-4aa1-b7b1-aeeb29ec0ece tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:48:22.736385 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-ac454130-ada0-4aa1-b7b1-aeeb29ec0ece tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:48:22.744064 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ac454130-ada0-4aa1-b7b1-aeeb29ec0ece tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:22.748012 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ac454130-ada0-4aa1-b7b1-aeeb29ec0ece tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:22.748012 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ac454130-ada0-4aa1-b7b1-aeeb29ec0ece tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:22.748012 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ac454130-ada0-4aa1-b7b1-aeeb29ec0ece tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:22.775204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-ac454130-ada0-4aa1-b7b1-aeeb29ec0ece tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044630 Jun 27 09:48:22.776713 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 531/1087] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 27 09:48:22 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:48:22.938989 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-d61616af-68b8-4e9f-b4e8-27b8c6a83d4a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:48:22.939558 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-d61616af-68b8-4e9f-b4e8-27b8c6a83d4a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:48:22.945751 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d61616af-68b8-4e9f-b4e8-27b8c6a83d4a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:22.946208 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d61616af-68b8-4e9f-b4e8-27b8c6a83d4a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:22.946977 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d61616af-68b8-4e9f-b4e8-27b8c6a83d4a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:22.947421 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-d61616af-68b8-4e9f-b4e8-27b8c6a83d4a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:22.975532 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-d61616af-68b8-4e9f-b4e8-27b8c6a83d4a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/os-volume_attachments/36a86b52-eff7-4088-bab4-856e989d918a" status: 200 len: 194 microversion: 2.1 time: 0.041532 Jun 27 09:48:22.976121 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 557/1088] 10.222.0.64 () {58 vars in 1412 bytes} [Mon Jun 27 09:48:22 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/os-volume_attachments/36a86b52-eff7-4088-bab4-856e989d918a => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:48:22.986299 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-9948785f-ee64-4b32-8e96-5e29e40ddc82 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:48:22.986796 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-9948785f-ee64-4b32-8e96-5e29e40ddc82 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:48:22.993403 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9948785f-ee64-4b32-8e96-5e29e40ddc82 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:22.993856 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9948785f-ee64-4b32-8e96-5e29e40ddc82 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:22.994617 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9948785f-ee64-4b32-8e96-5e29e40ddc82 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:22.995052 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-9948785f-ee64-4b32-8e96-5e29e40ddc82 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:23.073170 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.objects.instance [None req-9948785f-ee64-4b32-8e96-5e29e40ddc82 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lazy-loading 'services' on Instance uuid 95087d59-289d-459e-bb2d-0f57e11a0dda {{(pid=124870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:48:23.318997 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-9948785f-ee64-4b32-8e96-5e29e40ddc82 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "DELETE /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/os-volume_attachments/36a86b52-eff7-4088-bab4-856e989d918a" status: 202 len: 0 microversion: 2.1 time: 0.337068 Jun 27 09:48:23.319786 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 532/1089] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jun 27 09:48:22 2022] DELETE /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/os-volume_attachments/36a86b52-eff7-4088-bab4-856e989d918a => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:48:25.479554 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-8f9ead1d-f5e6-43f8-94d5-9de3d80a0966 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:48:25.480068 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-8f9ead1d-f5e6-43f8-94d5-9de3d80a0966 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:48:25.486873 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8f9ead1d-f5e6-43f8-94d5-9de3d80a0966 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:25.487317 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8f9ead1d-f5e6-43f8-94d5-9de3d80a0966 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:25.488110 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8f9ead1d-f5e6-43f8-94d5-9de3d80a0966 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:25.488540 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-8f9ead1d-f5e6-43f8-94d5-9de3d80a0966 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:25.516056 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-8f9ead1d-f5e6-43f8-94d5-9de3d80a0966 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/os-volume_attachments/3ee32f2a-4de0-4453-98e1-557cb929dd55" status: 200 len: 194 microversion: 2.1 time: 0.040421 Jun 27 09:48:25.516606 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 558/1090] 10.222.0.64 () {58 vars in 1412 bytes} [Mon Jun 27 09:48:25 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/os-volume_attachments/3ee32f2a-4de0-4453-98e1-557cb929dd55 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:48:25.527045 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-5a28b590-1f5e-4194-9eff-ee80a375488f tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:48:25.527601 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-5a28b590-1f5e-4194-9eff-ee80a375488f tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:48:25.533788 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5a28b590-1f5e-4194-9eff-ee80a375488f tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:25.534237 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5a28b590-1f5e-4194-9eff-ee80a375488f tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:25.535006 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5a28b590-1f5e-4194-9eff-ee80a375488f tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:25.535445 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-5a28b590-1f5e-4194-9eff-ee80a375488f tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:25.613609 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.objects.instance [None req-5a28b590-1f5e-4194-9eff-ee80a375488f tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lazy-loading 'services' on Instance uuid 95087d59-289d-459e-bb2d-0f57e11a0dda {{(pid=124870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:48:25.778987 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-5a28b590-1f5e-4194-9eff-ee80a375488f tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "DELETE /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/os-volume_attachments/3ee32f2a-4de0-4453-98e1-557cb929dd55" status: 202 len: 0 microversion: 2.1 time: 0.256481 Jun 27 09:48:25.779549 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 533/1091] 10.222.0.64 () {58 vars in 1415 bytes} [Mon Jun 27 09:48:25 2022] DELETE /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/os-volume_attachments/3ee32f2a-4de0-4453-98e1-557cb929dd55 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:48:26.931884 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-89d0508b-49dc-47ee-bc2b-ae2d5090506a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:48:26.932810 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-89d0508b-49dc-47ee-bc2b-ae2d5090506a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:48:26.939843 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-89d0508b-49dc-47ee-bc2b-ae2d5090506a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:26.940295 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-89d0508b-49dc-47ee-bc2b-ae2d5090506a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:26.941054 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-89d0508b-49dc-47ee-bc2b-ae2d5090506a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:26.941493 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-89d0508b-49dc-47ee-bc2b-ae2d5090506a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:26.968788 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-89d0508b-49dc-47ee-bc2b-ae2d5090506a tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040918 Jun 27 09:48:26.969327 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 559/1092] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 27 09:48:26 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 09:48:27.070724 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-168344b5-a2d1-4cf3-a17e-474a5e58a7a2 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:48:27.071799 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-168344b5-a2d1-4cf3-a17e-474a5e58a7a2 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:48:27.077947 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-168344b5-a2d1-4cf3-a17e-474a5e58a7a2 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:27.078403 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-168344b5-a2d1-4cf3-a17e-474a5e58a7a2 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:27.079212 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-168344b5-a2d1-4cf3-a17e-474a5e58a7a2 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:27.079682 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-168344b5-a2d1-4cf3-a17e-474a5e58a7a2 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:27.107511 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-168344b5-a2d1-4cf3-a17e-474a5e58a7a2 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041437 Jun 27 09:48:27.108031 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 534/1093] 10.222.0.64 () {58 vars in 1301 bytes} [Mon Jun 27 09:48:27 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 09:48:27.163083 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-fba5bade-bb31-47ee-a013-ff41b5688db2 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:48:27.163614 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-fba5bade-bb31-47ee-a013-ff41b5688db2 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:48:27.169471 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fba5bade-bb31-47ee-a013-ff41b5688db2 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:27.169923 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fba5bade-bb31-47ee-a013-ff41b5688db2 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:27.170685 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fba5bade-bb31-47ee-a013-ff41b5688db2 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:27.171124 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fba5bade-bb31-47ee-a013-ff41b5688db2 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:27.196133 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-fba5bade-bb31-47ee-a013-ff41b5688db2 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Going to try to terminate instance {{(pid=124869) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 09:48:27.502885 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-fba5bade-bb31-47ee-a013-ff41b5688db2 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "DELETE /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda" status: 204 len: 0 microversion: 2.1 time: 0.343263 Jun 27 09:48:27.503477 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 560/1094] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:48:27 2022] DELETE /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 09:48:27.511510 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-71afa8bb-29e9-43cc-a545-3097f48815c3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:48:27.512139 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-71afa8bb-29e9-43cc-a545-3097f48815c3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:48:27.518145 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-71afa8bb-29e9-43cc-a545-3097f48815c3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:27.518589 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-71afa8bb-29e9-43cc-a545-3097f48815c3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:27.519344 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-71afa8bb-29e9-43cc-a545-3097f48815c3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:27.519870 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-71afa8bb-29e9-43cc-a545-3097f48815c3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:27.647716 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-71afa8bb-29e9-43cc-a545-3097f48815c3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:48:27.655225 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-71afa8bb-29e9-43cc-a545-3097f48815c3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda" status: 200 len: 1675 microversion: 2.1 time: 0.147554 Jun 27 09:48:27.655807 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 535/1095] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:48:27 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:48:28.673914 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-15e243f2-e26e-41de-a0c4-8e563fb9888e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:48:28.674568 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-15e243f2-e26e-41de-a0c4-8e563fb9888e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:48:28.681241 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-15e243f2-e26e-41de-a0c4-8e563fb9888e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:28.681701 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-15e243f2-e26e-41de-a0c4-8e563fb9888e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:28.682473 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-15e243f2-e26e-41de-a0c4-8e563fb9888e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:28.682918 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-15e243f2-e26e-41de-a0c4-8e563fb9888e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:28.811952 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-15e243f2-e26e-41de-a0c4-8e563fb9888e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:48:28.822333 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-15e243f2-e26e-41de-a0c4-8e563fb9888e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda" status: 200 len: 1675 microversion: 2.1 time: 0.153000 Jun 27 09:48:28.822900 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 561/1096] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:48:28 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:48:29.840172 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c51e069f-5b7e-4763-9b0d-9a6b04d7f431 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:48:29.840710 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-c51e069f-5b7e-4763-9b0d-9a6b04d7f431 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:48:29.847664 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c51e069f-5b7e-4763-9b0d-9a6b04d7f431 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:29.848137 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c51e069f-5b7e-4763-9b0d-9a6b04d7f431 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:29.848877 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c51e069f-5b7e-4763-9b0d-9a6b04d7f431 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:29.849312 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c51e069f-5b7e-4763-9b0d-9a6b04d7f431 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:30.002487 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-c51e069f-5b7e-4763-9b0d-9a6b04d7f431 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:48:30.010003 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-c51e069f-5b7e-4763-9b0d-9a6b04d7f431 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda" status: 200 len: 1675 microversion: 2.1 time: 0.173733 Jun 27 09:48:30.010569 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 536/1097] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:48:29 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:48:30.344682 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-13520922-dae4-46bf-af7f-64095f3f7416 req-77616210-2069-41ec-8333-f67e4b6d0b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95087d59-289d-459e-bb2d-0f57e11a0dda", "name": "network-vif-deleted", "tag": "34935d13-04a1-4313-a5d2-6a9de448f426"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:48:30.354262 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-13520922-dae4-46bf-af7f-64095f3f7416 req-77616210-2069-41ec-8333-f67e4b6d0b5e service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:30.354700 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-13520922-dae4-46bf-af7f-64095f3f7416 req-77616210-2069-41ec-8333-f67e4b6d0b5e service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:30.367301 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-13520922-dae4-46bf-af7f-64095f3f7416 req-77616210-2069-41ec-8333-f67e4b6d0b5e service nova] Creating event network-vif-deleted:34935d13-04a1-4313-a5d2-6a9de448f426 for instance 95087d59-289d-459e-bb2d-0f57e11a0dda on hv-cinder-84773 Jun 27 09:48:30.372504 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-13520922-dae4-46bf-af7f-64095f3f7416 req-77616210-2069-41ec-8333-f67e4b6d0b5e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031602 Jun 27 09:48:30.373133 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 562/1098] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:48:31.027926 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-d6280c66-e06a-4787-a815-57b770e59fd3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:48:31.028623 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-d6280c66-e06a-4787-a815-57b770e59fd3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:48:31.035567 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d6280c66-e06a-4787-a815-57b770e59fd3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:31.036022 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d6280c66-e06a-4787-a815-57b770e59fd3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:31.036782 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d6280c66-e06a-4787-a815-57b770e59fd3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:31.037211 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d6280c66-e06a-4787-a815-57b770e59fd3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:31.068730 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d6280c66-e06a-4787-a815-57b770e59fd3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:31.069177 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-d6280c66-e06a-4787-a815-57b770e59fd3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:31.069619 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.objects.instance [None req-d6280c66-e06a-4787-a815-57b770e59fd3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lazy-loading 'fault' on Instance uuid 95087d59-289d-459e-bb2d-0f57e11a0dda {{(pid=124870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:48:31.112251 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-d6280c66-e06a-4787-a815-57b770e59fd3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '222b727863844d2b95a9c7222a56a94c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422340b9e5834d16bff3539c549fc4c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:48:31.120507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-d6280c66-e06a-4787-a815-57b770e59fd3 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda" status: 200 len: 1328 microversion: 2.1 time: 0.096330 Jun 27 09:48:31.121087 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 537/1099] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:48:31 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda => generated 1328 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:48:32.142309 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-1306ce0e-773d-45fc-b234-9ea54516b50e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:48:32.142932 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-1306ce0e-773d-45fc-b234-9ea54516b50e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:48:32.149121 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1306ce0e-773d-45fc-b234-9ea54516b50e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:32.149567 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1306ce0e-773d-45fc-b234-9ea54516b50e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:32.150316 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1306ce0e-773d-45fc-b234-9ea54516b50e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:32.150748 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-1306ce0e-773d-45fc-b234-9ea54516b50e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:32.163627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-1306ce0e-773d-45fc-b234-9ea54516b50e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] HTTP exception thrown: Instance 95087d59-289d-459e-bb2d-0f57e11a0dda could not be found. Jun 27 09:48:32.165205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-1306ce0e-773d-45fc-b234-9ea54516b50e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Request method failure captured: Jun 27 09:48:32.165205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda HTTP/1.1 Jun 27 09:48:32.165205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:48:32.165205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:48:32.165205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:48:32.165205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:48:32.165205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:48:32.165205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:48:32.165205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:48:32.165205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:48:32.165205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXvTrKIM95Pl7M9bFizxrCjoYgXqZOGIOTgZztOpR4fZUnBlhtPiHmJhZSnQqBQYLezPxjdfGlVsj5vWXnklQYhWzfCz05hpVbQE-rkvs9r6OgOnoOQw_3GFTI51wSXKW2wVxrTemH93QhntzwGkwnvFmUUTy_scFphGDs24Y_5thc8 Jun 27 09:48:32.165205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:48:32.165205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:48:32.165205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:48:32.165205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:48:32.165205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:48:32.165205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:48:32.165205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: 422340b9e5834d16bff3539c549fc4c1 Jun 27 09:48:32.165205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-AttachVolumeTestJSON-881212709 Jun 27 09:48:32.165205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:48:32.165205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:48:32.166891 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/422340b9e5834d16bff3539c549fc4c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/422340b9e5834d16bff3539c549fc4c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/422340b9e5834d16bff3539c549fc4c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_422340b9e5834d16bff3539c549fc4c1", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:48:32.166891 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-AttachVolumeTestJSON-881212709 Jun 27 09:48:32.166891 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: 422340b9e5834d16bff3539c549fc4c1 Jun 27 09:48:32.166891 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-AttachVolumeTestJSON-881212709 Jun 27 09:48:32.166891 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-AttachVolumeTestJSON-881212709-project Jun 27 09:48:32.166891 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:48:32.166891 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:48:32.166891 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: 222b727863844d2b95a9c7222a56a94c Jun 27 09:48:32.166891 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-AttachVolumeTestJSON-881212709-project Jun 27 09:48:32.166891 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: > Jun 27 09:48:32.166891 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Instance 95087d59-289d-459e-bb2d-0f57e11a0dda could not be found. Jun 27 09:48:32.166891 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'id': '95087d59-289d-459e-bb2d-0f57e11a0dda'} Jun 27 09:48:32.168060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:48:32.168060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:32.168060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:48:32.168060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:48:32.168060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:48:32.168060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:48:32.168060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:48:32.168060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:48:32.168060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:48:32.168060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:48:32.168060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95087d59-289d-459e-bb2d-0f57e11a0dda could not be found. Jun 27 09:48:32.168060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:32.168060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:32.168060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:32.168060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:32.168060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:48:32.168060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:48:32.168060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:48:32.168060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:48:32.168060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:48:32.169681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:48:32.169681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:48:32.169681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:48:32.169681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:48:32.169681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:48:32.169681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:48:32.169681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:48:32.169681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95087d59-289d-459e-bb2d-0f57e11a0dda could not be found. Jun 27 09:48:32.169681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:32.169681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:32.169681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:32.169681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:32.169681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:48:32.169681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:48:32.169681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:48:32.169681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:48:32.169681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95087d59-289d-459e-bb2d-0f57e11a0dda could not be found. Jun 27 09:48:32.169681 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:32.171262 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-1306ce0e-773d-45fc-b234-9ea54516b50e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Returning 404 to user: Instance 95087d59-289d-459e-bb2d-0f57e11a0dda could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:48:32.171262 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-1306ce0e-773d-45fc-b234-9ea54516b50e tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda" status: 404 len: 111 microversion: 2.1 time: 0.028926 Jun 27 09:48:32.171262 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 563/1100] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:48:32 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 09:48:32.176103 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-7d24703d-79fd-4771-8bff-d4dbacf07ead tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '.version_select at 0x7ffa97570ca0>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:48:32.255364 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-7d24703d-79fd-4771-8bff-d4dbacf07ead tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1114211473" status: 202 len: 0 microversion: 2.1 time: 0.083762 Jun 27 09:48:32.255959 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 538/1101] 10.222.0.64 () {58 vars in 1220 bytes} [Mon Jun 27 09:48:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1114211473 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:48:35.501815 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-6a900c48-4d15-411a-880b-a68ed101128d tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:48:35.502858 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-6a900c48-4d15-411a-880b-a68ed101128d tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:48:35.509428 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6a900c48-4d15-411a-880b-a68ed101128d tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:35.509884 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6a900c48-4d15-411a-880b-a68ed101128d tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:35.510650 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6a900c48-4d15-411a-880b-a68ed101128d tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:35.511090 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6a900c48-4d15-411a-880b-a68ed101128d tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:35.525047 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-6a900c48-4d15-411a-880b-a68ed101128d tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] HTTP exception thrown: Instance 95087d59-289d-459e-bb2d-0f57e11a0dda could not be found. Jun 27 09:48:35.526510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-6a900c48-4d15-411a-880b-a68ed101128d tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Request method failure captured: Jun 27 09:48:35.526510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: DELETE /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda HTTP/1.1 Jun 27 09:48:35.526510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:48:35.526510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:48:35.526510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:48:35.526510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:48:35.526510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:48:35.526510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:48:35.526510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:48:35.526510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:48:35.526510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXvTrKIM95Pl7M9bFizxrCjoYgXqZOGIOTgZztOpR4fZUnBlhtPiHmJhZSnQqBQYLezPxjdfGlVsj5vWXnklQYhWzfCz05hpVbQE-rkvs9r6OgOnoOQw_3GFTI51wSXKW2wVxrTemH93QhntzwGkwnvFmUUTy_scFphGDs24Y_5thc8 Jun 27 09:48:35.526510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:48:35.526510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:48:35.526510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:48:35.526510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:48:35.526510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:48:35.526510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:48:35.526510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: 422340b9e5834d16bff3539c549fc4c1 Jun 27 09:48:35.526510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-AttachVolumeTestJSON-881212709 Jun 27 09:48:35.526510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:48:35.526510 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:48:35.528157 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/422340b9e5834d16bff3539c549fc4c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/422340b9e5834d16bff3539c549fc4c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/422340b9e5834d16bff3539c549fc4c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_422340b9e5834d16bff3539c549fc4c1", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:48:35.528157 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-AttachVolumeTestJSON-881212709 Jun 27 09:48:35.528157 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: 422340b9e5834d16bff3539c549fc4c1 Jun 27 09:48:35.528157 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-AttachVolumeTestJSON-881212709 Jun 27 09:48:35.528157 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-AttachVolumeTestJSON-881212709-project Jun 27 09:48:35.528157 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:48:35.528157 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:48:35.528157 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: 222b727863844d2b95a9c7222a56a94c Jun 27 09:48:35.528157 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-AttachVolumeTestJSON-881212709-project Jun 27 09:48:35.528157 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: > Jun 27 09:48:35.528157 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Instance 95087d59-289d-459e-bb2d-0f57e11a0dda could not be found. Jun 27 09:48:35.528157 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'id': '95087d59-289d-459e-bb2d-0f57e11a0dda'} Jun 27 09:48:35.529019 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:48:35.529019 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:35.529019 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:48:35.529019 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:48:35.529019 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:48:35.529019 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:48:35.529019 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:48:35.529019 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:48:35.529019 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:48:35.529019 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:48:35.529019 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95087d59-289d-459e-bb2d-0f57e11a0dda could not be found. Jun 27 09:48:35.529019 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:35.529019 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:35.529019 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:35.529019 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:35.529019 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:48:35.529019 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:48:35.529019 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:48:35.529019 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:48:35.529019 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:48:35.530319 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:48:35.530319 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 09:48:35.530319 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 09:48:35.530319 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 09:48:35.530319 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 09:48:35.530319 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:48:35.530319 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:48:35.530319 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:48:35.530319 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:48:35.530319 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95087d59-289d-459e-bb2d-0f57e11a0dda could not be found. Jun 27 09:48:35.530319 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:35.530319 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:35.530319 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:35.530319 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:35.530319 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:48:35.530319 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:48:35.530319 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:48:35.530319 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:48:35.530319 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95087d59-289d-459e-bb2d-0f57e11a0dda could not be found. Jun 27 09:48:35.530319 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:35.531618 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-6a900c48-4d15-411a-880b-a68ed101128d tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Returning 404 to user: Instance 95087d59-289d-459e-bb2d-0f57e11a0dda could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:48:35.531618 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-6a900c48-4d15-411a-880b-a68ed101128d tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "DELETE /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda" status: 404 len: 111 microversion: 2.1 time: 0.029959 Jun 27 09:48:35.531618 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 564/1102] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:48:35 2022] DELETE /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 09:48:35.536778 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-83f0bea0-cf92-4ef1-a26d-390ab0517549 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:48:35.537402 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-83f0bea0-cf92-4ef1-a26d-390ab0517549 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 95087d59-289d-459e-bb2d-0f57e11a0dda] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:48:35.544303 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-83f0bea0-cf92-4ef1-a26d-390ab0517549 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:35.544762 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-83f0bea0-cf92-4ef1-a26d-390ab0517549 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:35.545538 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-83f0bea0-cf92-4ef1-a26d-390ab0517549 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:35.545981 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-83f0bea0-cf92-4ef1-a26d-390ab0517549 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:35.559369 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-83f0bea0-cf92-4ef1-a26d-390ab0517549 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] HTTP exception thrown: Instance 95087d59-289d-459e-bb2d-0f57e11a0dda could not be found. Jun 27 09:48:35.561073 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-83f0bea0-cf92-4ef1-a26d-390ab0517549 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Request method failure captured: Jun 27 09:48:35.561073 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda HTTP/1.1 Jun 27 09:48:35.561073 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:48:35.561073 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:48:35.561073 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:48:35.561073 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:48:35.561073 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:48:35.561073 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:48:35.561073 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:48:35.561073 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:48:35.561073 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXvTrKIM95Pl7M9bFizxrCjoYgXqZOGIOTgZztOpR4fZUnBlhtPiHmJhZSnQqBQYLezPxjdfGlVsj5vWXnklQYhWzfCz05hpVbQE-rkvs9r6OgOnoOQw_3GFTI51wSXKW2wVxrTemH93QhntzwGkwnvFmUUTy_scFphGDs24Y_5thc8 Jun 27 09:48:35.561073 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:48:35.561073 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:48:35.561073 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:48:35.561073 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:48:35.561073 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:48:35.561073 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:48:35.561073 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: 422340b9e5834d16bff3539c549fc4c1 Jun 27 09:48:35.561073 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-AttachVolumeTestJSON-881212709 Jun 27 09:48:35.561073 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:48:35.561073 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:48:35.562809 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/422340b9e5834d16bff3539c549fc4c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/422340b9e5834d16bff3539c549fc4c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/422340b9e5834d16bff3539c549fc4c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_422340b9e5834d16bff3539c549fc4c1", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:48:35.562809 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-AttachVolumeTestJSON-881212709 Jun 27 09:48:35.562809 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: 422340b9e5834d16bff3539c549fc4c1 Jun 27 09:48:35.562809 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-AttachVolumeTestJSON-881212709 Jun 27 09:48:35.562809 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-AttachVolumeTestJSON-881212709-project Jun 27 09:48:35.562809 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:48:35.562809 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:48:35.562809 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: 222b727863844d2b95a9c7222a56a94c Jun 27 09:48:35.562809 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-AttachVolumeTestJSON-881212709-project Jun 27 09:48:35.562809 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: > Jun 27 09:48:35.562809 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Instance 95087d59-289d-459e-bb2d-0f57e11a0dda could not be found. Jun 27 09:48:35.562809 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': '95087d59-289d-459e-bb2d-0f57e11a0dda'} Jun 27 09:48:35.563836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:48:35.563836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:35.563836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:48:35.563836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:48:35.563836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:48:35.563836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:48:35.563836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:48:35.563836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:48:35.563836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:48:35.563836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:48:35.563836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95087d59-289d-459e-bb2d-0f57e11a0dda could not be found. Jun 27 09:48:35.563836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:35.563836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:35.563836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:35.563836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:35.563836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:48:35.563836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:48:35.563836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:48:35.563836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:48:35.563836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:48:35.565850 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:48:35.565850 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:48:35.565850 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:48:35.565850 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:48:35.565850 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:48:35.565850 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:48:35.565850 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:48:35.565850 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95087d59-289d-459e-bb2d-0f57e11a0dda could not be found. Jun 27 09:48:35.565850 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:35.565850 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:35.565850 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:35.565850 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:35.565850 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:48:35.565850 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:48:35.565850 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:48:35.565850 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:48:35.565850 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95087d59-289d-459e-bb2d-0f57e11a0dda could not be found. Jun 27 09:48:35.565850 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:35.567141 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-83f0bea0-cf92-4ef1-a26d-390ab0517549 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Returning 404 to user: Instance 95087d59-289d-459e-bb2d-0f57e11a0dda could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:48:35.567141 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-83f0bea0-cf92-4ef1-a26d-390ab0517549 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda" status: 404 len: 111 microversion: 2.1 time: 0.030180 Jun 27 09:48:35.567141 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 539/1103] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:48:35 2022] GET /compute/v2.1/servers/95087d59-289d-459e-bb2d-0f57e11a0dda => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:48:36.873955 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-bab7cdbe-82c8-423f-956f-bca96e2b7fcc tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:48:36.874538 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-bab7cdbe-82c8-423f-956f-bca96e2b7fcc tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:48:36.880614 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-bab7cdbe-82c8-423f-956f-bca96e2b7fcc tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:36.881058 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-bab7cdbe-82c8-423f-956f-bca96e2b7fcc tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:36.881820 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-bab7cdbe-82c8-423f-956f-bca96e2b7fcc tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:36.882254 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-bab7cdbe-82c8-423f-956f-bca96e2b7fcc tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:36.895955 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-bab7cdbe-82c8-423f-956f-bca96e2b7fcc tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] HTTP exception thrown: Instance 852e3cbc-67cd-4e86-b5ba-bdf54a75d114 could not be found. Jun 27 09:48:36.897476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-bab7cdbe-82c8-423f-956f-bca96e2b7fcc tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Request method failure captured: Jun 27 09:48:36.897476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: DELETE /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 HTTP/1.1 Jun 27 09:48:36.897476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:48:36.897476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:48:36.897476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:48:36.897476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:48:36.897476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:48:36.897476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:48:36.897476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:48:36.897476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:48:36.897476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXvTrKIM95Pl7M9bFizxrCjoYgXqZOGIOTgZztOpR4fZUnBlhtPiHmJhZSnQqBQYLezPxjdfGlVsj5vWXnklQYhWzfCz05hpVbQE-rkvs9r6OgOnoOQw_3GFTI51wSXKW2wVxrTemH93QhntzwGkwnvFmUUTy_scFphGDs24Y_5thc8 Jun 27 09:48:36.897476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:48:36.897476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:48:36.897476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:48:36.897476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:48:36.897476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:48:36.897476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:48:36.897476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: 422340b9e5834d16bff3539c549fc4c1 Jun 27 09:48:36.897476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-AttachVolumeTestJSON-881212709 Jun 27 09:48:36.897476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:48:36.897476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:48:36.899102 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/422340b9e5834d16bff3539c549fc4c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/422340b9e5834d16bff3539c549fc4c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/422340b9e5834d16bff3539c549fc4c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_422340b9e5834d16bff3539c549fc4c1", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:48:36.899102 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-AttachVolumeTestJSON-881212709 Jun 27 09:48:36.899102 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: 422340b9e5834d16bff3539c549fc4c1 Jun 27 09:48:36.899102 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-AttachVolumeTestJSON-881212709 Jun 27 09:48:36.899102 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-AttachVolumeTestJSON-881212709-project Jun 27 09:48:36.899102 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:48:36.899102 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:48:36.899102 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: 222b727863844d2b95a9c7222a56a94c Jun 27 09:48:36.899102 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-AttachVolumeTestJSON-881212709-project Jun 27 09:48:36.899102 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: > Jun 27 09:48:36.899102 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Instance 852e3cbc-67cd-4e86-b5ba-bdf54a75d114 could not be found. Jun 27 09:48:36.899102 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'id': '852e3cbc-67cd-4e86-b5ba-bdf54a75d114'} Jun 27 09:48:36.900129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:48:36.900129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:36.900129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:48:36.900129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:48:36.900129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:48:36.900129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:48:36.900129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:48:36.900129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:48:36.900129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:48:36.900129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:48:36.900129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 852e3cbc-67cd-4e86-b5ba-bdf54a75d114 could not be found. Jun 27 09:48:36.900129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:36.900129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:36.900129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:36.900129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:36.900129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:48:36.900129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:48:36.900129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:48:36.900129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:48:36.900129 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:48:36.901461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:48:36.901461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 09:48:36.901461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 09:48:36.901461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 09:48:36.901461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 09:48:36.901461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:48:36.901461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:48:36.901461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:48:36.901461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:48:36.901461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 852e3cbc-67cd-4e86-b5ba-bdf54a75d114 could not be found. Jun 27 09:48:36.901461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:36.901461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:36.901461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:36.901461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:36.901461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:48:36.901461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:48:36.901461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:48:36.901461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:48:36.901461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 852e3cbc-67cd-4e86-b5ba-bdf54a75d114 could not be found. Jun 27 09:48:36.901461 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:36.902910 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-bab7cdbe-82c8-423f-956f-bca96e2b7fcc tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Returning 404 to user: Instance 852e3cbc-67cd-4e86-b5ba-bdf54a75d114 could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:48:36.902910 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-bab7cdbe-82c8-423f-956f-bca96e2b7fcc tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "DELETE /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 404 len: 111 microversion: 2.1 time: 0.028688 Jun 27 09:48:36.902910 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 565/1104] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:48:36 2022] DELETE /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:48:36.907304 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-ef465d5b-9394-4b10-8d8a-9a33fae2df06 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:48:36.907972 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-ef465d5b-9394-4b10-8d8a-9a33fae2df06 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] [instance: 852e3cbc-67cd-4e86-b5ba-bdf54a75d114] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:48:36.915139 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ef465d5b-9394-4b10-8d8a-9a33fae2df06 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:36.915653 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ef465d5b-9394-4b10-8d8a-9a33fae2df06 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:36.916431 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ef465d5b-9394-4b10-8d8a-9a33fae2df06 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:48:36.916872 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ef465d5b-9394-4b10-8d8a-9a33fae2df06 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:48:36.932070 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-ef465d5b-9394-4b10-8d8a-9a33fae2df06 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] HTTP exception thrown: Instance 852e3cbc-67cd-4e86-b5ba-bdf54a75d114 could not be found. Jun 27 09:48:36.933580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-ef465d5b-9394-4b10-8d8a-9a33fae2df06 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Request method failure captured: Jun 27 09:48:36.933580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 HTTP/1.1 Jun 27 09:48:36.933580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:48:36.933580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:48:36.933580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:48:36.933580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:48:36.933580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:48:36.933580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:48:36.933580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:48:36.933580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:48:36.933580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXvTrKIM95Pl7M9bFizxrCjoYgXqZOGIOTgZztOpR4fZUnBlhtPiHmJhZSnQqBQYLezPxjdfGlVsj5vWXnklQYhWzfCz05hpVbQE-rkvs9r6OgOnoOQw_3GFTI51wSXKW2wVxrTemH93QhntzwGkwnvFmUUTy_scFphGDs24Y_5thc8 Jun 27 09:48:36.933580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:48:36.933580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:48:36.933580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:48:36.933580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:48:36.933580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:48:36.933580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:48:36.933580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: 422340b9e5834d16bff3539c549fc4c1 Jun 27 09:48:36.933580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-AttachVolumeTestJSON-881212709 Jun 27 09:48:36.933580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:48:36.933580 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:48:36.935226 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/422340b9e5834d16bff3539c549fc4c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/422340b9e5834d16bff3539c549fc4c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/422340b9e5834d16bff3539c549fc4c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_422340b9e5834d16bff3539c549fc4c1", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:48:36.935226 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-AttachVolumeTestJSON-881212709 Jun 27 09:48:36.935226 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: 422340b9e5834d16bff3539c549fc4c1 Jun 27 09:48:36.935226 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-AttachVolumeTestJSON-881212709 Jun 27 09:48:36.935226 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-AttachVolumeTestJSON-881212709-project Jun 27 09:48:36.935226 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:48:36.935226 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:48:36.935226 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: 222b727863844d2b95a9c7222a56a94c Jun 27 09:48:36.935226 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-AttachVolumeTestJSON-881212709-project Jun 27 09:48:36.935226 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: > Jun 27 09:48:36.935226 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Instance 852e3cbc-67cd-4e86-b5ba-bdf54a75d114 could not be found. Jun 27 09:48:36.935226 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': '852e3cbc-67cd-4e86-b5ba-bdf54a75d114'} Jun 27 09:48:36.936204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:48:36.936204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:36.936204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:48:36.936204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:48:36.936204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:48:36.936204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:48:36.936204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:48:36.936204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:48:36.936204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:48:36.936204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:48:36.936204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 852e3cbc-67cd-4e86-b5ba-bdf54a75d114 could not be found. Jun 27 09:48:36.936204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:36.936204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:36.936204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:36.936204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:36.936204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:48:36.936204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:48:36.936204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:48:36.936204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:48:36.936204 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:48:36.937719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:48:36.937719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:48:36.937719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:48:36.937719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:48:36.937719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:48:36.937719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:48:36.937719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:48:36.937719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 852e3cbc-67cd-4e86-b5ba-bdf54a75d114 could not be found. Jun 27 09:48:36.937719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:36.937719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:36.937719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:36.937719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:36.937719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:48:36.937719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:48:36.937719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:48:36.937719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:48:36.937719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 852e3cbc-67cd-4e86-b5ba-bdf54a75d114 could not be found. Jun 27 09:48:36.937719 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:36.939150 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-ef465d5b-9394-4b10-8d8a-9a33fae2df06 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] Returning 404 to user: Instance 852e3cbc-67cd-4e86-b5ba-bdf54a75d114 could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:48:36.939150 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-ef465d5b-9394-4b10-8d8a-9a33fae2df06 tempest-AttachVolumeTestJSON-881212709 tempest-AttachVolumeTestJSON-881212709-project] 10.222.0.64 "GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114" status: 404 len: 111 microversion: 2.1 time: 0.031614 Jun 27 09:48:36.939150 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 540/1105] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:48:36 2022] GET /compute/v2.1/servers/852e3cbc-67cd-4e86-b5ba-bdf54a75d114 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:48:42.048618 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-4b61278e-6847-4169-8930-8a173e189868 tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] Action: 'create', calling method: .version_select at 0x7ffa974be0d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-262978232", "metadata": {"Type": "work"}}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:48:42.066400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-4b61278e-6847-4169-8930-8a173e189868 tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] Request method failure captured: Jun 27 09:48:42.066400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 27 09:48:42.066400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:48:42.066400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:48:42.066400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:48:42.066400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 121 Jun 27 09:48:42.066400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:48:42.066400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:48:42.066400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:48:42.066400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:48:42.066400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXz5qM6ZJUgEoRxEs0mSXoOvQNacCl89VdLy7v9aTPI2WF5WYXPglarpURGAbIvd4l5iM4CD0eC5v61rBewyvrp3Xxs0poEfN2jM3UV3B4_93LmhR20CeHbEBeGWuFnjF295VDbKF449IILqfDoNGCrbOzCfbt_NbTFvPsUBodKonkA Jun 27 09:48:42.066400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:48:42.066400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:48:42.066400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:48:42.066400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:48:42.066400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:48:42.066400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:48:42.066400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: e0499021ec5e479db8de9c925c515910 Jun 27 09:48:42.066400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-VolumesNegativeTest-189262496 Jun 27 09:48:42.066400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:48:42.066400 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:48:42.068071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e0499021ec5e479db8de9c925c515910"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e0499021ec5e479db8de9c925c515910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e0499021ec5e479db8de9c925c515910"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e0499021ec5e479db8de9c925c515910", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:48:42.068071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-VolumesNegativeTest-189262496 Jun 27 09:48:42.068071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: e0499021ec5e479db8de9c925c515910 Jun 27 09:48:42.068071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-VolumesNegativeTest-189262496 Jun 27 09:48:42.068071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-VolumesNegativeTest-189262496-project Jun 27 09:48:42.068071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:48:42.068071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:48:42.068071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: a474031094074aaf8333df2414c37a0a Jun 27 09:48:42.068071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-VolumesNegativeTest-189262496-project Jun 27 09:48:42.068071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Jun 27 09:48:42.068071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-262978232", "metadata": {"Type": "work"}}} Jun 27 09:48:42.068071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: Jun 27 09:48:42.068071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 27 09:48:42.069071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-262978232', 'metadata': {'Type': 'work'}}}} Jun 27 09:48:42.069071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:48:42.069071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:42.069071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 27 09:48:42.069071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 27 09:48:42.069071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 27 09:48:42.069071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise error Jun 27 09:48:42.069071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 27 09:48:42.069071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.069071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 27 09:48:42.069071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 27 09:48:42.069071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.069071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 27 09:48:42.069071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi '#$%' Jun 27 09:48:42.069071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.069071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:42.069071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.069071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:42.069071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:48:42.069071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:48:42.069071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:48:42.069071 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:48:42.071107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 09:48:42.071107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 09:48:42.071107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:48:42.071107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:48:42.071107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 27 09:48:42.071107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 27 09:48:42.071107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 27 09:48:42.071107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 27 09:48:42.071107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 27 09:48:42.071107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 27 09:48:42.071107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 27 09:48:42.071107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.071107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:42.071107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.071107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:42.071107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:48:42.071107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:48:42.071107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 27 09:48:42.071107 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 27 09:48:42.072946 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 27 09:48:42.072946 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.072946 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-4b61278e-6847-4169-8930-8a173e189868 tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:48:42.072946 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-4b61278e-6847-4169-8930-8a173e189868 tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.147236 Jun 27 09:48:42.072946 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 566/1106] 10.222.0.64 () {60 vars in 1155 bytes} [Mon Jun 27 09:48:41 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 27 09:48:42.077446 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-de5cc626-974d-42d4-acf7-1d721229279c tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] Action: 'create', calling method: .version_select at 0x7ffa9753fd30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1728890391", "metadata": {"Type": "work"}}} {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:48:42.080836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-de5cc626-974d-42d4-acf7-1d721229279c tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] Request method failure captured: Jun 27 09:48:42.080836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 27 09:48:42.080836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:48:42.080836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:48:42.080836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:48:42.080836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 120 Jun 27 09:48:42.080836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:48:42.080836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:48:42.080836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:48:42.080836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:48:42.080836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXz5qM6ZJUgEoRxEs0mSXoOvQNacCl89VdLy7v9aTPI2WF5WYXPglarpURGAbIvd4l5iM4CD0eC5v61rBewyvrp3Xxs0poEfN2jM3UV3B4_93LmhR20CeHbEBeGWuFnjF295VDbKF449IILqfDoNGCrbOzCfbt_NbTFvPsUBodKonkA Jun 27 09:48:42.080836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:48:42.080836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:48:42.080836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:48:42.080836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:48:42.080836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:48:42.080836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:48:42.080836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: e0499021ec5e479db8de9c925c515910 Jun 27 09:48:42.080836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-VolumesNegativeTest-189262496 Jun 27 09:48:42.080836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:48:42.080836 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:48:42.082515 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e0499021ec5e479db8de9c925c515910"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e0499021ec5e479db8de9c925c515910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e0499021ec5e479db8de9c925c515910"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e0499021ec5e479db8de9c925c515910", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:48:42.082515 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-VolumesNegativeTest-189262496 Jun 27 09:48:42.082515 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: e0499021ec5e479db8de9c925c515910 Jun 27 09:48:42.082515 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-VolumesNegativeTest-189262496 Jun 27 09:48:42.082515 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-VolumesNegativeTest-189262496-project Jun 27 09:48:42.082515 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:48:42.082515 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:48:42.082515 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: a474031094074aaf8333df2414c37a0a Jun 27 09:48:42.082515 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-VolumesNegativeTest-189262496-project Jun 27 09:48:42.082515 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Jun 27 09:48:42.082515 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1728890391", "metadata": {"Type": "work"}}} Jun 27 09:48:42.082515 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: Jun 27 09:48:42.082515 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 27 09:48:42.083574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1728890391', 'metadata': {'Type': 'work'}}}} Jun 27 09:48:42.083574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:48:42.083574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:42.083574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 27 09:48:42.083574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 27 09:48:42.083574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 27 09:48:42.083574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise error Jun 27 09:48:42.083574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 27 09:48:42.083574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.083574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 27 09:48:42.083574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 27 09:48:42.083574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.083574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 27 09:48:42.083574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi '0' Jun 27 09:48:42.083574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.083574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:42.083574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.083574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:42.083574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:48:42.083574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:48:42.083574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:48:42.083574 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:48:42.085327 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 09:48:42.085327 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 09:48:42.085327 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:48:42.085327 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:48:42.085327 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 27 09:48:42.085327 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 27 09:48:42.085327 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 27 09:48:42.085327 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 27 09:48:42.085327 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 27 09:48:42.085327 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 27 09:48:42.085327 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 27 09:48:42.085327 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.085327 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:42.085327 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.085327 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:42.085327 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:48:42.085327 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:48:42.085327 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 27 09:48:42.085327 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 27 09:48:42.086685 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 27 09:48:42.086685 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.086685 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-de5cc626-974d-42d4-acf7-1d721229279c tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:48:42.086685 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-de5cc626-974d-42d4-acf7-1d721229279c tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008785 Jun 27 09:48:42.086685 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 541/1107] 10.222.0.64 () {60 vars in 1155 bytes} [Mon Jun 27 09:48:42 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 27 09:48:42.091551 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f8d83cef-fbfa-4c65-8685-881808cada83 tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] Action: 'create', calling method: .version_select at 0x7ffa975cf670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1134316244", "metadata": {"Type": "work"}}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:48:42.094712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f8d83cef-fbfa-4c65-8685-881808cada83 tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] Request method failure captured: Jun 27 09:48:42.094712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 27 09:48:42.094712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:48:42.094712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:48:42.094712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:48:42.094712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 119 Jun 27 09:48:42.094712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:48:42.094712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:48:42.094712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:48:42.094712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:48:42.094712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXz5qM6ZJUgEoRxEs0mSXoOvQNacCl89VdLy7v9aTPI2WF5WYXPglarpURGAbIvd4l5iM4CD0eC5v61rBewyvrp3Xxs0poEfN2jM3UV3B4_93LmhR20CeHbEBeGWuFnjF295VDbKF449IILqfDoNGCrbOzCfbt_NbTFvPsUBodKonkA Jun 27 09:48:42.094712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:48:42.094712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:48:42.094712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:48:42.094712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:48:42.094712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:48:42.094712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:48:42.094712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: e0499021ec5e479db8de9c925c515910 Jun 27 09:48:42.094712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-VolumesNegativeTest-189262496 Jun 27 09:48:42.094712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:48:42.094712 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:48:42.102369 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e0499021ec5e479db8de9c925c515910"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e0499021ec5e479db8de9c925c515910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e0499021ec5e479db8de9c925c515910"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e0499021ec5e479db8de9c925c515910", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:48:42.102369 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-VolumesNegativeTest-189262496 Jun 27 09:48:42.102369 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: e0499021ec5e479db8de9c925c515910 Jun 27 09:48:42.102369 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-VolumesNegativeTest-189262496 Jun 27 09:48:42.102369 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-VolumesNegativeTest-189262496-project Jun 27 09:48:42.102369 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:48:42.102369 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:48:42.102369 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: a474031094074aaf8333df2414c37a0a Jun 27 09:48:42.102369 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-VolumesNegativeTest-189262496-project Jun 27 09:48:42.102369 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Jun 27 09:48:42.102369 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1134316244", "metadata": {"Type": "work"}}} Jun 27 09:48:42.102369 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: Jun 27 09:48:42.102369 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 27 09:48:42.103492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1134316244', 'metadata': {'Type': 'work'}}}} Jun 27 09:48:42.103492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:48:42.103492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:42.103492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 27 09:48:42.103492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 27 09:48:42.103492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 27 09:48:42.103492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise error Jun 27 09:48:42.103492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 27 09:48:42.103492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.103492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 27 09:48:42.103492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 27 09:48:42.103492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.103492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 27 09:48:42.103492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi '' Jun 27 09:48:42.103492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.103492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:42.103492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.103492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:42.103492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:48:42.103492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:48:42.103492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:48:42.103492 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:48:42.105213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 09:48:42.105213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 09:48:42.105213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:48:42.105213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:48:42.105213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 27 09:48:42.105213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 27 09:48:42.105213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 27 09:48:42.105213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 27 09:48:42.105213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 27 09:48:42.105213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 27 09:48:42.105213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 27 09:48:42.105213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.105213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:42.105213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.105213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:42.105213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:48:42.105213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:48:42.105213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 27 09:48:42.105213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 27 09:48:42.106707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 27 09:48:42.106707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.106707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f8d83cef-fbfa-4c65-8685-881808cada83 tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:48:42.106707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-f8d83cef-fbfa-4c65-8685-881808cada83 tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008322 Jun 27 09:48:42.106707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 567/1108] 10.222.0.64 () {60 vars in 1155 bytes} [Mon Jun 27 09:48:42 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 27 09:48:42.109353 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c496f042-37f7-4155-a2d5-dd86d7c3d28c tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] Calling method '.version_select at 0x7ffa973a1310>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:48:42.137529 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-c496f042-37f7-4155-a2d5-dd86d7c3d28c tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] HTTP exception thrown: Volume tempest-invalid-460257250 could not be found. Jun 27 09:48:42.140507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c496f042-37f7-4155-a2d5-dd86d7c3d28c tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] Request method failure captured: Jun 27 09:48:42.140507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-460257250 HTTP/1.1 Jun 27 09:48:42.140507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:48:42.140507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:48:42.140507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:48:42.140507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:48:42.140507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:48:42.140507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:48:42.140507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:48:42.140507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:48:42.140507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXz5qM6ZJUgEoRxEs0mSXoOvQNacCl89VdLy7v9aTPI2WF5WYXPglarpURGAbIvd4l5iM4CD0eC5v61rBewyvrp3Xxs0poEfN2jM3UV3B4_93LmhR20CeHbEBeGWuFnjF295VDbKF449IILqfDoNGCrbOzCfbt_NbTFvPsUBodKonkA Jun 27 09:48:42.140507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:48:42.140507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:48:42.140507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:48:42.140507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:48:42.140507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:48:42.140507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:48:42.140507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: e0499021ec5e479db8de9c925c515910 Jun 27 09:48:42.140507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-VolumesNegativeTest-189262496 Jun 27 09:48:42.140507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:48:42.140507 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:48:42.142195 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e0499021ec5e479db8de9c925c515910"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e0499021ec5e479db8de9c925c515910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e0499021ec5e479db8de9c925c515910"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e0499021ec5e479db8de9c925c515910", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:48:42.142195 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-VolumesNegativeTest-189262496 Jun 27 09:48:42.142195 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: e0499021ec5e479db8de9c925c515910 Jun 27 09:48:42.142195 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-VolumesNegativeTest-189262496 Jun 27 09:48:42.142195 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-VolumesNegativeTest-189262496-project Jun 27 09:48:42.142195 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:48:42.142195 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:48:42.142195 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: a474031094074aaf8333df2414c37a0a Jun 27 09:48:42.142195 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-VolumesNegativeTest-189262496-project Jun 27 09:48:42.142195 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: Jun 27 09:48:42.142195 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Volume tempest-invalid-460257250 could not be found. Jun 27 09:48:42.142195 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': 'tempest-invalid-460257250'} Jun 27 09:48:42.142195 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:48:42.143587 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:42.143587 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 09:48:42.143587 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 09:48:42.143587 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 09:48:42.143587 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 09:48:42.143587 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 09:48:42.143587 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 09:48:42.143587 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 09:48:42.143587 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 09:48:42.143587 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 09:48:42.143587 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 09:48:42.143587 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 09:48:42.143587 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 09:48:42.143587 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 09:48:42.143587 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 09:48:42.143587 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-460257250 could not be found. (HTTP 404) (Request-ID: req-02d034b6-6fc2-437f-9a98-efd5bd3fbb1a) Jun 27 09:48:42.143587 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.143587 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:42.143587 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.145034 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:42.145034 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 27 09:48:42.145034 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 27 09:48:42.145034 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 09:48:42.145034 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 09:48:42.145034 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 09:48:42.145034 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 09:48:42.145034 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 09:48:42.145034 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 09:48:42.145034 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 09:48:42.145034 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 09:48:42.145034 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 09:48:42.145034 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 09:48:42.145034 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 09:48:42.145034 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 09:48:42.145034 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 09:48:42.145034 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 09:48:42.145034 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 09:48:42.145034 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 09:48:42.146504 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 09:48:42.146504 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 09:48:42.146504 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 09:48:42.146504 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 09:48:42.146504 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-460257250 could not be found. Jun 27 09:48:42.146504 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.146504 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:42.146504 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.146504 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:42.146504 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:48:42.146504 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:48:42.146504 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:48:42.146504 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:48:42.146504 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 09:48:42.146504 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 09:48:42.146504 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:48:42.146504 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:48:42.146504 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 27 09:48:42.146504 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:48:42.146504 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-460257250 could not be found. Jun 27 09:48:42.148235 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.148235 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:42.148235 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.148235 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:42.148235 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:48:42.148235 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:48:42.148235 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:48:42.148235 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:48:42.148235 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-460257250 could not be found. Jun 27 09:48:42.148235 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.148235 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c496f042-37f7-4155-a2d5-dd86d7c3d28c tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] Returning 404 to user: Volume tempest-invalid-460257250 could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:48:42.148235 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-c496f042-37f7-4155-a2d5-dd86d7c3d28c tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/tempest-invalid-460257250" status: 404 len: 98 microversion: 2.1 time: 0.036721 Jun 27 09:48:42.148235 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 542/1109] 10.222.0.64 () {58 vars in 1214 bytes} [Mon Jun 27 09:48:42 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-460257250 => generated 98 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 27 09:48:42.152103 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-7d379d76-b906-48ec-88dc-a5526a257c37 tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003716 Jun 27 09:48:42.152591 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 568/1110] 10.222.0.64 () {58 vars in 1139 bytes} [Mon Jun 27 09:48:42 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 27 09:48:42.161003 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-05d7ab7c-4df2-46dc-ae07-ce817ad6e277 tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004178 Jun 27 09:48:42.161483 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 543/1111] 10.222.0.64 () {58 vars in 1136 bytes} [Mon Jun 27 09:48:42 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 27 09:48:42.169481 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f81421a5-62da-45a1-9e8d-57ff9aacd495 tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] Calling method '.version_select at 0x7ffa975f8310>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:48:42.197720 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.wsgi [None req-f81421a5-62da-45a1-9e8d-57ff9aacd495 tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] HTTP exception thrown: Volume 4984bdba-be07-4ef6-8d9f-98fac98c7f6d could not be found. Jun 27 09:48:42.199707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f81421a5-62da-45a1-9e8d-57ff9aacd495 tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] Request method failure captured: Jun 27 09:48:42.199707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: request: DELETE /compute/v2.1/os-volumes/4984bdba-be07-4ef6-8d9f-98fac98c7f6d HTTP/1.1 Jun 27 09:48:42.199707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept: application/json Jun 27 09:48:42.199707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Accept-Encoding: identity Jun 27 09:48:42.199707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Connection: close Jun 27 09:48:42.199707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Length: 0 Jun 27 09:48:42.199707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Content-Type: application/json Jun 27 09:48:42.199707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Host: 10.222.0.64 Jun 27 09:48:42.199707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Openstack-System-Scope: None Jun 27 09:48:42.199707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: User-Agent: python-urllib3/1.26.9 Jun 27 09:48:42.199707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Auth-Token: gAAAAABiuXz5qM6ZJUgEoRxEs0mSXoOvQNacCl89VdLy7v9aTPI2WF5WYXPglarpURGAbIvd4l5iM4CD0eC5v61rBewyvrp3Xxs0poEfN2jM3UV3B4_93LmhR20CeHbEBeGWuFnjF295VDbKF449IILqfDoNGCrbOzCfbt_NbTFvPsUBodKonkA Jun 27 09:48:42.199707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Id: None Jun 27 09:48:42.199707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Domain-Name: None Jun 27 09:48:42.199707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Identity-Status: Confirmed Jun 27 09:48:42.199707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Is-Admin-Project: True Jun 27 09:48:42.199707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Id: default Jun 27 09:48:42.199707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Domain-Name: Default Jun 27 09:48:42.199707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Id: e0499021ec5e479db8de9c925c515910 Jun 27 09:48:42.199707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Project-Name: tempest-VolumesNegativeTest-189262496 Jun 27 09:48:42.199707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Role: reader,member Jun 27 09:48:42.199707 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Roles: reader,member Jun 27 09:48:42.201352 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e0499021ec5e479db8de9c925c515910"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e0499021ec5e479db8de9c925c515910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e0499021ec5e479db8de9c925c515910"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e0499021ec5e479db8de9c925c515910", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:48:42.201352 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant: tempest-VolumesNegativeTest-189262496 Jun 27 09:48:42.201352 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Id: e0499021ec5e479db8de9c925c515910 Jun 27 09:48:42.201352 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-Tenant-Name: tempest-VolumesNegativeTest-189262496 Jun 27 09:48:42.201352 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User: tempest-VolumesNegativeTest-189262496-project Jun 27 09:48:42.201352 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Id: default Jun 27 09:48:42.201352 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Domain-Name: Default Jun 27 09:48:42.201352 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Id: a474031094074aaf8333df2414c37a0a Jun 27 09:48:42.201352 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: X-User-Name: tempest-VolumesNegativeTest-189262496-project Jun 27 09:48:42.201352 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: method: Jun 27 09:48:42.201352 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: exception: Volume 4984bdba-be07-4ef6-8d9f-98fac98c7f6d could not be found. Jun 27 09:48:42.201352 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: action_args: {'id': '4984bdba-be07-4ef6-8d9f-98fac98c7f6d'} Jun 27 09:48:42.201352 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:48:42.202654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:42.202654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 09:48:42.202654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 09:48:42.202654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 09:48:42.202654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 09:48:42.202654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 09:48:42.202654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 09:48:42.202654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 09:48:42.202654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 09:48:42.202654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 09:48:42.202654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 09:48:42.202654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 09:48:42.202654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 09:48:42.202654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 09:48:42.202654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 09:48:42.202654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4984bdba-be07-4ef6-8d9f-98fac98c7f6d could not be found. (HTTP 404) (Request-ID: req-d2ca02c3-b5bf-4bf9-bf68-4b514763c7c7) Jun 27 09:48:42.202654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.202654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:42.202654 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.204179 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:42.204179 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 27 09:48:42.204179 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 27 09:48:42.204179 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 09:48:42.204179 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 09:48:42.204179 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 09:48:42.204179 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 09:48:42.204179 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 09:48:42.204179 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 09:48:42.204179 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 09:48:42.204179 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 09:48:42.204179 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 09:48:42.204179 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 09:48:42.204179 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 09:48:42.204179 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 09:48:42.204179 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 09:48:42.204179 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 09:48:42.204179 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 09:48:42.204179 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 09:48:42.205693 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 09:48:42.205693 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 09:48:42.205693 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 09:48:42.205693 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 09:48:42.205693 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4984bdba-be07-4ef6-8d9f-98fac98c7f6d could not be found. Jun 27 09:48:42.205693 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.205693 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:42.205693 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.205693 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:42.205693 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:48:42.205693 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:48:42.205693 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:48:42.205693 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:48:42.205693 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 09:48:42.205693 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 09:48:42.205693 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:48:42.205693 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:48:42.205693 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 27 09:48:42.205693 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:48:42.207222 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4984bdba-be07-4ef6-8d9f-98fac98c7f6d could not be found. Jun 27 09:48:42.207222 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.207222 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:42.207222 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.207222 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:42.207222 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:48:42.207222 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:48:42.207222 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:48:42.207222 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:48:42.207222 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4984bdba-be07-4ef6-8d9f-98fac98c7f6d could not be found. Jun 27 09:48:42.207222 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.207222 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-f81421a5-62da-45a1-9e8d-57ff9aacd495 tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] Returning 404 to user: Volume 4984bdba-be07-4ef6-8d9f-98fac98c7f6d could not be found. {{(pid=124869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:48:42.207222 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-f81421a5-62da-45a1-9e8d-57ff9aacd495 tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/4984bdba-be07-4ef6-8d9f-98fac98c7f6d" status: 404 len: 109 microversion: 2.1 time: 0.035093 Jun 27 09:48:42.207222 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 569/1112] 10.222.0.64 () {58 vars in 1247 bytes} [Mon Jun 27 09:48:42 2022] DELETE /compute/v2.1/os-volumes/4984bdba-be07-4ef6-8d9f-98fac98c7f6d => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:48:42.211687 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-fcad560c-2585-4e41-8292-2f66d0d2b90d tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] Calling method '.version_select at 0x7ffa9753f4c0>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:48:42.238812 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-fcad560c-2585-4e41-8292-2f66d0d2b90d tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] HTTP exception thrown: Volume ae122b8e-b9b3-4ffe-b786-4d9e276c4e21 could not be found. Jun 27 09:48:42.240776 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-fcad560c-2585-4e41-8292-2f66d0d2b90d tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] Request method failure captured: Jun 27 09:48:42.240776 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: GET /compute/v2.1/os-volumes/ae122b8e-b9b3-4ffe-b786-4d9e276c4e21 HTTP/1.1 Jun 27 09:48:42.240776 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:48:42.240776 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:48:42.240776 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:48:42.240776 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:48:42.240776 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:48:42.240776 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:48:42.240776 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:48:42.240776 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:48:42.240776 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXz5qM6ZJUgEoRxEs0mSXoOvQNacCl89VdLy7v9aTPI2WF5WYXPglarpURGAbIvd4l5iM4CD0eC5v61rBewyvrp3Xxs0poEfN2jM3UV3B4_93LmhR20CeHbEBeGWuFnjF295VDbKF449IILqfDoNGCrbOzCfbt_NbTFvPsUBodKonkA Jun 27 09:48:42.240776 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:48:42.240776 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:48:42.240776 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:48:42.240776 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:48:42.240776 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:48:42.240776 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:48:42.240776 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: e0499021ec5e479db8de9c925c515910 Jun 27 09:48:42.240776 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-VolumesNegativeTest-189262496 Jun 27 09:48:42.240776 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:48:42.240776 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:48:42.242424 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e0499021ec5e479db8de9c925c515910"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e0499021ec5e479db8de9c925c515910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e0499021ec5e479db8de9c925c515910"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e0499021ec5e479db8de9c925c515910", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:48:42.242424 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-VolumesNegativeTest-189262496 Jun 27 09:48:42.242424 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: e0499021ec5e479db8de9c925c515910 Jun 27 09:48:42.242424 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-VolumesNegativeTest-189262496 Jun 27 09:48:42.242424 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-VolumesNegativeTest-189262496-project Jun 27 09:48:42.242424 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:48:42.242424 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:48:42.242424 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: a474031094074aaf8333df2414c37a0a Jun 27 09:48:42.242424 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-VolumesNegativeTest-189262496-project Jun 27 09:48:42.242424 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: Jun 27 09:48:42.242424 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Volume ae122b8e-b9b3-4ffe-b786-4d9e276c4e21 could not be found. Jun 27 09:48:42.242424 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': 'ae122b8e-b9b3-4ffe-b786-4d9e276c4e21'} Jun 27 09:48:42.242424 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:48:42.243474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:42.243474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 09:48:42.243474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 09:48:42.243474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 09:48:42.243474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 09:48:42.243474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 09:48:42.243474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 09:48:42.243474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 09:48:42.243474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 09:48:42.243474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 09:48:42.243474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 09:48:42.243474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 09:48:42.243474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 09:48:42.243474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 09:48:42.243474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 09:48:42.243474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ae122b8e-b9b3-4ffe-b786-4d9e276c4e21 could not be found. (HTTP 404) (Request-ID: req-59a50d1c-1ecf-40a7-acda-f2d6b97c336c) Jun 27 09:48:42.243474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.243474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:42.243474 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.244954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:42.244954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 09:48:42.244954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 09:48:42.244954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 09:48:42.244954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 09:48:42.244954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 09:48:42.244954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 09:48:42.244954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 09:48:42.244954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 09:48:42.244954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 09:48:42.244954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 09:48:42.244954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 09:48:42.244954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 09:48:42.244954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 09:48:42.244954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 09:48:42.244954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 09:48:42.244954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 09:48:42.244954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 09:48:42.244954 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 09:48:42.246416 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 09:48:42.246416 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 09:48:42.246416 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 09:48:42.246416 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 09:48:42.246416 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ae122b8e-b9b3-4ffe-b786-4d9e276c4e21 could not be found. Jun 27 09:48:42.246416 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.246416 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:42.246416 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.246416 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:42.246416 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:48:42.246416 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:48:42.246416 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:48:42.246416 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:48:42.246416 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 09:48:42.246416 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 09:48:42.246416 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:48:42.246416 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:48:42.246416 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 09:48:42.246416 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:48:42.247907 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ae122b8e-b9b3-4ffe-b786-4d9e276c4e21 could not be found. Jun 27 09:48:42.247907 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.247907 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:48:42.247907 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.247907 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:48:42.247907 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:48:42.247907 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:48:42.247907 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:48:42.247907 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:48:42.247907 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ae122b8e-b9b3-4ffe-b786-4d9e276c4e21 could not be found. Jun 27 09:48:42.247907 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:48:42.247907 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-fcad560c-2585-4e41-8292-2f66d0d2b90d tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] Returning 404 to user: Volume ae122b8e-b9b3-4ffe-b786-4d9e276c4e21 could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:48:42.247907 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-fcad560c-2585-4e41-8292-2f66d0d2b90d tempest-VolumesNegativeTest-189262496 tempest-VolumesNegativeTest-189262496-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/ae122b8e-b9b3-4ffe-b786-4d9e276c4e21" status: 404 len: 109 microversion: 2.1 time: 0.034642 Jun 27 09:48:42.247907 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 544/1113] 10.222.0.64 () {58 vars in 1244 bytes} [Mon Jun 27 09:48:42 2022] GET /compute/v2.1/os-volumes/ae122b8e-b9b3-4ffe-b786-4d9e276c4e21 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:49:39.227435 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 09:49:39.228021 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Mon Jun 27 09:49:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 09:49:55.515160 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:49:55.515937 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:49:55.520279 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-5a93384c-abec-4dde-a89a-fe0440072606 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:49:55.520814 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-5a93384c-abec-4dde-a89a-fe0440072606 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:49:55.532205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5a93384c-abec-4dde-a89a-fe0440072606 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:49:55.532205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5a93384c-abec-4dde-a89a-fe0440072606 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:49:55.532205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5a93384c-abec-4dde-a89a-fe0440072606 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:49:55.532205 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-5a93384c-abec-4dde-a89a-fe0440072606 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:49:55.551060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.objects.instance [None req-5a93384c-abec-4dde-a89a-fe0440072606 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lazy-loading 'flavor' on Instance uuid 526bfd18-438f-40ca-a0a2-23590d5712c2 {{(pid=124869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:49:55.882090 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-5a93384c-abec-4dde-a89a-fe0440072606 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "POST /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2/action" status: 202 len: 0 microversion: 2.1 time: 0.368353 Jun 27 09:49:55.882585 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 570/1114] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 27 09:49:55 2022] POST /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 09:49:55.889068 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:49:55.889904 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:49:55.894707 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-4cd05dc6-1ba4-4e13-ae85-5856c25084bd tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:49:55.895582 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-4cd05dc6-1ba4-4e13-ae85-5856c25084bd tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:49:55.901585 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4cd05dc6-1ba4-4e13-ae85-5856c25084bd tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:49:55.902039 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4cd05dc6-1ba4-4e13-ae85-5856c25084bd tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:49:55.902874 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4cd05dc6-1ba4-4e13-ae85-5856c25084bd tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:49:55.903314 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-4cd05dc6-1ba4-4e13-ae85-5856c25084bd tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:49:56.036621 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-4cd05dc6-1ba4-4e13-ae85-5856c25084bd tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:49:56.044527 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-4cd05dc6-1ba4-4e13-ae85-5856c25084bd tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1567 microversion: 2.1 time: 0.157458 Jun 27 09:49:56.046780 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 545/1115] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:49:55 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:49:57.064554 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-a5b5fd62-41a3-49b0-b6b8-81d8067127d2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:49:57.065257 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-a5b5fd62-41a3-49b0-b6b8-81d8067127d2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:49:57.071437 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a5b5fd62-41a3-49b0-b6b8-81d8067127d2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:49:57.071918 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a5b5fd62-41a3-49b0-b6b8-81d8067127d2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:49:57.072689 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a5b5fd62-41a3-49b0-b6b8-81d8067127d2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:49:57.073130 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-a5b5fd62-41a3-49b0-b6b8-81d8067127d2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:49:57.202391 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-a5b5fd62-41a3-49b0-b6b8-81d8067127d2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:49:57.210541 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-a5b5fd62-41a3-49b0-b6b8-81d8067127d2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1567 microversion: 2.1 time: 0.150826 Jun 27 09:49:57.211102 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 571/1116] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:49:57 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:49:58.228596 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-f545c321-3184-4009-bf57-120e9025f83f tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:49:58.229216 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-f545c321-3184-4009-bf57-120e9025f83f tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:49:58.235840 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f545c321-3184-4009-bf57-120e9025f83f tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:49:58.236298 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f545c321-3184-4009-bf57-120e9025f83f tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:49:58.237076 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f545c321-3184-4009-bf57-120e9025f83f tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:49:58.237536 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f545c321-3184-4009-bf57-120e9025f83f tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:49:58.365469 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-f545c321-3184-4009-bf57-120e9025f83f tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:49:58.373043 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-f545c321-3184-4009-bf57-120e9025f83f tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1567 microversion: 2.1 time: 0.148782 Jun 27 09:49:58.373597 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 546/1117] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:49:58 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:49:59.388940 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-34199346-9676-4183-8762-637db9147452 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:49:59.389580 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-34199346-9676-4183-8762-637db9147452 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:49:59.396308 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-34199346-9676-4183-8762-637db9147452 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:49:59.396813 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-34199346-9676-4183-8762-637db9147452 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:49:59.397581 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-34199346-9676-4183-8762-637db9147452 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:49:59.398080 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-34199346-9676-4183-8762-637db9147452 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:49:59.530587 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-34199346-9676-4183-8762-637db9147452 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:49:59.538876 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-34199346-9676-4183-8762-637db9147452 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1567 microversion: 2.1 time: 0.153843 Jun 27 09:49:59.539453 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 572/1118] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:49:59 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:50:00.556868 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-c2f0f6b9-d7dd-4535-a7f2-b16a4ce0561e tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:50:00.557417 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-c2f0f6b9-d7dd-4535-a7f2-b16a4ce0561e tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:50:00.563686 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c2f0f6b9-d7dd-4535-a7f2-b16a4ce0561e tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:00.564143 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c2f0f6b9-d7dd-4535-a7f2-b16a4ce0561e tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:00.564914 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c2f0f6b9-d7dd-4535-a7f2-b16a4ce0561e tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:00.565352 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-c2f0f6b9-d7dd-4535-a7f2-b16a4ce0561e tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:00.695905 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-c2f0f6b9-d7dd-4535-a7f2-b16a4ce0561e tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:50:00.703316 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-c2f0f6b9-d7dd-4535-a7f2-b16a4ce0561e tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1567 microversion: 2.1 time: 0.150533 Jun 27 09:50:00.703904 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 547/1119] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:50:00 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:50:01.720490 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-12ae5d09-c103-4fc6-b0c0-100dba3e95e2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:50:01.721028 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-12ae5d09-c103-4fc6-b0c0-100dba3e95e2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:50:01.727512 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-12ae5d09-c103-4fc6-b0c0-100dba3e95e2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:01.728054 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-12ae5d09-c103-4fc6-b0c0-100dba3e95e2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:01.728806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-12ae5d09-c103-4fc6-b0c0-100dba3e95e2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:01.729234 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-12ae5d09-c103-4fc6-b0c0-100dba3e95e2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:01.859121 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-12ae5d09-c103-4fc6-b0c0-100dba3e95e2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:50:01.866594 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-12ae5d09-c103-4fc6-b0c0-100dba3e95e2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1567 microversion: 2.1 time: 0.150114 Jun 27 09:50:01.867156 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 573/1120] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:50:01 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:50:02.883617 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-b6ea7482-ca0d-4cd7-9476-39dee1185166 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:50:02.884234 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-b6ea7482-ca0d-4cd7-9476-39dee1185166 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:50:02.890708 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b6ea7482-ca0d-4cd7-9476-39dee1185166 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:02.891156 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b6ea7482-ca0d-4cd7-9476-39dee1185166 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:02.891947 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b6ea7482-ca0d-4cd7-9476-39dee1185166 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:02.892388 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-b6ea7482-ca0d-4cd7-9476-39dee1185166 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:03.020449 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-b6ea7482-ca0d-4cd7-9476-39dee1185166 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:50:03.033313 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-b6ea7482-ca0d-4cd7-9476-39dee1185166 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1567 microversion: 2.1 time: 0.153532 Jun 27 09:50:03.033892 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 548/1121] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:50:02 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:50:04.051216 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-4f4419f3-fa5b-4c07-b894-33c5a45384b2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:50:04.051816 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-4f4419f3-fa5b-4c07-b894-33c5a45384b2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:50:04.058450 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4f4419f3-fa5b-4c07-b894-33c5a45384b2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:04.058901 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4f4419f3-fa5b-4c07-b894-33c5a45384b2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:04.059722 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4f4419f3-fa5b-4c07-b894-33c5a45384b2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:04.060163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-4f4419f3-fa5b-4c07-b894-33c5a45384b2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:04.188423 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-4f4419f3-fa5b-4c07-b894-33c5a45384b2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:50:04.195931 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-4f4419f3-fa5b-4c07-b894-33c5a45384b2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1567 microversion: 2.1 time: 0.149450 Jun 27 09:50:04.196505 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 574/1122] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:50:04 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:50:05.212812 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-892af262-6e18-43ce-901f-9bc6f2b504bb tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:50:05.213421 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-892af262-6e18-43ce-901f-9bc6f2b504bb tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:50:05.219945 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-892af262-6e18-43ce-901f-9bc6f2b504bb tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:05.220397 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-892af262-6e18-43ce-901f-9bc6f2b504bb tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:05.221165 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-892af262-6e18-43ce-901f-9bc6f2b504bb tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:05.221599 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-892af262-6e18-43ce-901f-9bc6f2b504bb tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:05.351373 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-892af262-6e18-43ce-901f-9bc6f2b504bb tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:50:05.359043 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-892af262-6e18-43ce-901f-9bc6f2b504bb tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1567 microversion: 2.1 time: 0.150059 Jun 27 09:50:05.359857 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 549/1123] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:50:05 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:50:06.376995 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-20b4f973-08d8-4e48-94de-b89dba584e88 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:50:06.377604 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-20b4f973-08d8-4e48-94de-b89dba584e88 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:50:06.384115 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-20b4f973-08d8-4e48-94de-b89dba584e88 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:06.384567 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-20b4f973-08d8-4e48-94de-b89dba584e88 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:06.385330 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-20b4f973-08d8-4e48-94de-b89dba584e88 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:06.385767 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-20b4f973-08d8-4e48-94de-b89dba584e88 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:06.517364 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-20b4f973-08d8-4e48-94de-b89dba584e88 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:50:06.524930 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-20b4f973-08d8-4e48-94de-b89dba584e88 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1567 microversion: 2.1 time: 0.151826 Jun 27 09:50:06.525429 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 575/1124] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:50:06 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:50:07.541888 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-3767ff64-c2f3-431b-8c6f-7671191efdce tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:50:07.542466 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-3767ff64-c2f3-431b-8c6f-7671191efdce tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:50:07.549551 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3767ff64-c2f3-431b-8c6f-7671191efdce tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:07.550044 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3767ff64-c2f3-431b-8c6f-7671191efdce tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:07.550808 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3767ff64-c2f3-431b-8c6f-7671191efdce tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:07.551241 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-3767ff64-c2f3-431b-8c6f-7671191efdce tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:07.684861 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-3767ff64-c2f3-431b-8c6f-7671191efdce tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:50:07.692850 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-3767ff64-c2f3-431b-8c6f-7671191efdce tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1567 microversion: 2.1 time: 0.154849 Jun 27 09:50:07.693409 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 550/1125] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:50:07 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:50:08.709944 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-dd4b2ae9-835f-4300-8942-06cd95596de1 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:50:08.710572 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-dd4b2ae9-835f-4300-8942-06cd95596de1 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:50:08.716972 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dd4b2ae9-835f-4300-8942-06cd95596de1 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:08.717410 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dd4b2ae9-835f-4300-8942-06cd95596de1 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:08.718163 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dd4b2ae9-835f-4300-8942-06cd95596de1 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:08.718600 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-dd4b2ae9-835f-4300-8942-06cd95596de1 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:08.849741 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-dd4b2ae9-835f-4300-8942-06cd95596de1 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:50:08.857177 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-dd4b2ae9-835f-4300-8942-06cd95596de1 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1567 microversion: 2.1 time: 0.151604 Jun 27 09:50:08.857740 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 576/1126] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:50:08 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:50:09.873986 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-493ff06b-34ed-4188-a291-f64afab4fe3f tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:50:09.874591 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-493ff06b-34ed-4188-a291-f64afab4fe3f tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:50:09.881081 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-493ff06b-34ed-4188-a291-f64afab4fe3f tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:09.881524 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-493ff06b-34ed-4188-a291-f64afab4fe3f tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:09.882279 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-493ff06b-34ed-4188-a291-f64afab4fe3f tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:09.882708 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-493ff06b-34ed-4188-a291-f64afab4fe3f tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:10.017470 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-493ff06b-34ed-4188-a291-f64afab4fe3f tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:50:10.025161 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-493ff06b-34ed-4188-a291-f64afab4fe3f tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1568 microversion: 2.1 time: 0.154922 Jun 27 09:50:10.036514 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 551/1127] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:50:09 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:50:10.042083 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-622a213f-15fe-4266-a6aa-713a3cc22b68 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:50:10.042676 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-622a213f-15fe-4266-a6aa-713a3cc22b68 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:50:10.049515 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-622a213f-15fe-4266-a6aa-713a3cc22b68 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:10.050586 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-622a213f-15fe-4266-a6aa-713a3cc22b68 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:10.051354 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-622a213f-15fe-4266-a6aa-713a3cc22b68 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:10.051817 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-622a213f-15fe-4266-a6aa-713a3cc22b68 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:10.324765 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-622a213f-15fe-4266-a6aa-713a3cc22b68 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "POST /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2/action" status: 202 len: 0 microversion: 2.1 time: 0.286492 Jun 27 09:50:10.326146 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 577/1128] 10.222.0.64 () {60 vars in 1277 bytes} [Mon Jun 27 09:50:10 2022] POST /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 09:50:10.334070 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a768929f-6f89-4a15-941c-cb1b256978b3 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:50:10.334674 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-a768929f-6f89-4a15-941c-cb1b256978b3 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:50:10.340725 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a768929f-6f89-4a15-941c-cb1b256978b3 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:10.341171 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a768929f-6f89-4a15-941c-cb1b256978b3 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:10.341930 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a768929f-6f89-4a15-941c-cb1b256978b3 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:10.342360 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a768929f-6f89-4a15-941c-cb1b256978b3 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:10.503967 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a768929f-6f89-4a15-941c-cb1b256978b3 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:50:10.511751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-a768929f-6f89-4a15-941c-cb1b256978b3 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1516 microversion: 2.1 time: 0.182016 Jun 27 09:50:10.512322 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 552/1129] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:50:10 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:50:11.238325 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-9a41a4c7-d8ce-4abc-86b2-853457293f11 req-6a4f81c4-7742-4a23-918e-316a1ef9679c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "526bfd18-438f-40ca-a0a2-23590d5712c2", "name": "network-vif-unplugged", "status": "completed", "tag": "9d599bda-d36b-48fc-9462-bc44070afb0c"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:50:11.247763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-9a41a4c7-d8ce-4abc-86b2-853457293f11 req-6a4f81c4-7742-4a23-918e-316a1ef9679c service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:11.248212 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-9a41a4c7-d8ce-4abc-86b2-853457293f11 req-6a4f81c4-7742-4a23-918e-316a1ef9679c service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:11.259363 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.compute.server_external_events [req-9a41a4c7-d8ce-4abc-86b2-853457293f11 req-6a4f81c4-7742-4a23-918e-316a1ef9679c service nova] Unable to find a host for instance 526bfd18-438f-40ca-a0a2-23590d5712c2. Dropping event network-vif-unplugged {{(pid=124869) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 27 09:50:11.260283 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-9a41a4c7-d8ce-4abc-86b2-853457293f11 req-6a4f81c4-7742-4a23-918e-316a1ef9679c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026399 Jun 27 09:50:11.260867 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 578/1130] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 27 09:50:11.530407 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-f15adcd7-9855-4590-8f31-ec25bd50b4eb tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:50:11.531032 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-f15adcd7-9855-4590-8f31-ec25bd50b4eb tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:50:11.538313 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f15adcd7-9855-4590-8f31-ec25bd50b4eb tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:11.538809 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f15adcd7-9855-4590-8f31-ec25bd50b4eb tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:11.539604 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f15adcd7-9855-4590-8f31-ec25bd50b4eb tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:11.540048 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-f15adcd7-9855-4590-8f31-ec25bd50b4eb tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:11.672438 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-f15adcd7-9855-4590-8f31-ec25bd50b4eb tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:50:11.680752 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-f15adcd7-9855-4590-8f31-ec25bd50b4eb tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1518 microversion: 2.1 time: 0.155074 Jun 27 09:50:11.681314 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 553/1131] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:50:11 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:50:12.698555 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-fa3d5045-c15a-4788-b2e7-d8667739e5a5 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:50:12.705070 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-fa3d5045-c15a-4788-b2e7-d8667739e5a5 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:50:12.705741 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fa3d5045-c15a-4788-b2e7-d8667739e5a5 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:12.706182 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fa3d5045-c15a-4788-b2e7-d8667739e5a5 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:12.706944 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fa3d5045-c15a-4788-b2e7-d8667739e5a5 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:12.707374 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-fa3d5045-c15a-4788-b2e7-d8667739e5a5 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:12.843353 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-fa3d5045-c15a-4788-b2e7-d8667739e5a5 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:50:12.851572 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-fa3d5045-c15a-4788-b2e7-d8667739e5a5 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1518 microversion: 2.1 time: 0.156891 Jun 27 09:50:12.852184 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 579/1132] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:50:12 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:50:13.868397 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-fafcdb1b-c0e7-4505-aac2-0005af1f9732 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:50:13.868993 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-fafcdb1b-c0e7-4505-aac2-0005af1f9732 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:50:13.875432 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fafcdb1b-c0e7-4505-aac2-0005af1f9732 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:13.881601 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fafcdb1b-c0e7-4505-aac2-0005af1f9732 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:13.881601 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fafcdb1b-c0e7-4505-aac2-0005af1f9732 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:13.881601 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-fafcdb1b-c0e7-4505-aac2-0005af1f9732 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:14.008013 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-fafcdb1b-c0e7-4505-aac2-0005af1f9732 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:50:14.015365 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-fafcdb1b-c0e7-4505-aac2-0005af1f9732 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1574 microversion: 2.1 time: 0.150867 Jun 27 09:50:14.016065 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 554/1133] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:50:13 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:50:15.032246 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-6e543183-e830-4608-8657-5ee616dbb2a2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:50:15.032849 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-6e543183-e830-4608-8657-5ee616dbb2a2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:50:15.039272 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6e543183-e830-4608-8657-5ee616dbb2a2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:15.039744 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6e543183-e830-4608-8657-5ee616dbb2a2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:15.040504 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6e543183-e830-4608-8657-5ee616dbb2a2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:15.040936 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-6e543183-e830-4608-8657-5ee616dbb2a2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:15.169232 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-6e543183-e830-4608-8657-5ee616dbb2a2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:50:15.177673 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-6e543183-e830-4608-8657-5ee616dbb2a2 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1574 microversion: 2.1 time: 0.149187 Jun 27 09:50:15.178179 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 580/1134] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:50:15 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:50:16.194113 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e295b5b2-0cef-4fb0-b867-b9b7d9e75fae tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:50:16.194986 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e295b5b2-0cef-4fb0-b867-b9b7d9e75fae tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:50:16.201583 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e295b5b2-0cef-4fb0-b867-b9b7d9e75fae tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:16.202030 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e295b5b2-0cef-4fb0-b867-b9b7d9e75fae tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:16.202800 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e295b5b2-0cef-4fb0-b867-b9b7d9e75fae tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:16.203239 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e295b5b2-0cef-4fb0-b867-b9b7d9e75fae tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:16.334071 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-e295b5b2-0cef-4fb0-b867-b9b7d9e75fae tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:50:16.341792 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e295b5b2-0cef-4fb0-b867-b9b7d9e75fae tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1574 microversion: 2.1 time: 0.151506 Jun 27 09:50:16.342709 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 555/1135] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:50:16 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:50:17.358898 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-26424cc6-e0f3-4963-9483-74821112edf8 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:50:17.359511 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-26424cc6-e0f3-4963-9483-74821112edf8 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:50:17.366743 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-26424cc6-e0f3-4963-9483-74821112edf8 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:17.367198 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-26424cc6-e0f3-4963-9483-74821112edf8 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:17.367991 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-26424cc6-e0f3-4963-9483-74821112edf8 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:17.368433 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-26424cc6-e0f3-4963-9483-74821112edf8 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:17.497739 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-26424cc6-e0f3-4963-9483-74821112edf8 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:50:17.505221 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-26424cc6-e0f3-4963-9483-74821112edf8 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1574 microversion: 2.1 time: 0.150246 Jun 27 09:50:17.505790 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 581/1136] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:50:17 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:50:18.521629 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-dc78c275-f192-47d9-91ba-ef87e049ed66 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:50:18.522235 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-dc78c275-f192-47d9-91ba-ef87e049ed66 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:50:18.528870 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dc78c275-f192-47d9-91ba-ef87e049ed66 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:18.529274 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dc78c275-f192-47d9-91ba-ef87e049ed66 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:18.530033 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dc78c275-f192-47d9-91ba-ef87e049ed66 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:18.530468 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-dc78c275-f192-47d9-91ba-ef87e049ed66 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:18.659973 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-dc78c275-f192-47d9-91ba-ef87e049ed66 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:50:18.667321 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-dc78c275-f192-47d9-91ba-ef87e049ed66 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1574 microversion: 2.1 time: 0.149714 Jun 27 09:50:18.667913 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 556/1137] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:50:18 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:50:19.684806 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-eb0ab81b-8101-4445-b7c3-4e583119fd56 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:50:19.685380 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-eb0ab81b-8101-4445-b7c3-4e583119fd56 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:50:19.692259 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-eb0ab81b-8101-4445-b7c3-4e583119fd56 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:19.692709 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-eb0ab81b-8101-4445-b7c3-4e583119fd56 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:19.693534 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-eb0ab81b-8101-4445-b7c3-4e583119fd56 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:19.693892 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-eb0ab81b-8101-4445-b7c3-4e583119fd56 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:19.821668 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-eb0ab81b-8101-4445-b7c3-4e583119fd56 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:50:19.829061 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-eb0ab81b-8101-4445-b7c3-4e583119fd56 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1574 microversion: 2.1 time: 0.148181 Jun 27 09:50:19.829658 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 582/1138] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:50:19 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:50:20.846068 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-a4706a1b-6d0c-41e9-9976-e482609fad27 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:50:20.846677 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-a4706a1b-6d0c-41e9-9976-e482609fad27 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:50:20.853745 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a4706a1b-6d0c-41e9-9976-e482609fad27 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:20.854192 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a4706a1b-6d0c-41e9-9976-e482609fad27 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:20.854949 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a4706a1b-6d0c-41e9-9976-e482609fad27 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:20.855389 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-a4706a1b-6d0c-41e9-9976-e482609fad27 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:20.981772 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-a4706a1b-6d0c-41e9-9976-e482609fad27 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:50:20.989114 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-a4706a1b-6d0c-41e9-9976-e482609fad27 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1574 microversion: 2.1 time: 0.146881 Jun 27 09:50:20.989668 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 557/1139] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:50:20 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1574 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:50:22.005787 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-911b050e-cc21-46f9-b9cb-3e775709c637 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:50:22.006388 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-911b050e-cc21-46f9-b9cb-3e775709c637 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:50:22.013146 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-911b050e-cc21-46f9-b9cb-3e775709c637 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:22.013583 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-911b050e-cc21-46f9-b9cb-3e775709c637 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:22.014335 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-911b050e-cc21-46f9-b9cb-3e775709c637 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:22.014763 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-911b050e-cc21-46f9-b9cb-3e775709c637 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:22.145201 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-911b050e-cc21-46f9-b9cb-3e775709c637 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:50:22.152607 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-911b050e-cc21-46f9-b9cb-3e775709c637 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1574 microversion: 2.1 time: 0.150657 Jun 27 09:50:22.156852 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 583/1140] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:50:22 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:50:23.169793 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-ad32de32-1681-432e-aa6c-a4fa5a0c0702 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:50:23.170404 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-ad32de32-1681-432e-aa6c-a4fa5a0c0702 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:50:23.177704 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ad32de32-1681-432e-aa6c-a4fa5a0c0702 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:23.178151 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ad32de32-1681-432e-aa6c-a4fa5a0c0702 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:23.178918 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ad32de32-1681-432e-aa6c-a4fa5a0c0702 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:23.179352 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-ad32de32-1681-432e-aa6c-a4fa5a0c0702 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:23.312079 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-ad32de32-1681-432e-aa6c-a4fa5a0c0702 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:50:23.320243 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-ad32de32-1681-432e-aa6c-a4fa5a0c0702 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1574 microversion: 2.1 time: 0.154271 Jun 27 09:50:23.320818 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 558/1141] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:50:23 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:50:23.345925 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-dbe1afaa-d090-4c5c-8827-21f88e2530bd req-f273a4fc-e97e-4d51-a418-3694eab13f4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "526bfd18-438f-40ca-a0a2-23590d5712c2", "name": "network-vif-plugged", "status": "completed", "tag": "9d599bda-d36b-48fc-9462-bc44070afb0c"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:50:23.354994 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-dbe1afaa-d090-4c5c-8827-21f88e2530bd req-f273a4fc-e97e-4d51-a418-3694eab13f4c service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:23.365535 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-dbe1afaa-d090-4c5c-8827-21f88e2530bd req-f273a4fc-e97e-4d51-a418-3694eab13f4c service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:23.365535 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:50:23.366981 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-dbe1afaa-d090-4c5c-8827-21f88e2530bd req-f273a4fc-e97e-4d51-a418-3694eab13f4c service nova] Creating event network-vif-plugged:9d599bda-d36b-48fc-9462-bc44070afb0c for instance 526bfd18-438f-40ca-a0a2-23590d5712c2 on hv-cinder-84773 Jun 27 09:50:23.372216 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-dbe1afaa-d090-4c5c-8827-21f88e2530bd req-f273a4fc-e97e-4d51-a418-3694eab13f4c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029826 Jun 27 09:50:23.372721 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 584/1142] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:50:24.336923 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-752162eb-65a5-4f77-9f67-202a25d75cce tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:50:24.337534 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-752162eb-65a5-4f77-9f67-202a25d75cce tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:50:24.344049 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-752162eb-65a5-4f77-9f67-202a25d75cce tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:24.344497 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-752162eb-65a5-4f77-9f67-202a25d75cce tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:24.345257 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-752162eb-65a5-4f77-9f67-202a25d75cce tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:24.345688 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-752162eb-65a5-4f77-9f67-202a25d75cce tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:24.474360 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-752162eb-65a5-4f77-9f67-202a25d75cce tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:50:24.481726 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-752162eb-65a5-4f77-9f67-202a25d75cce tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1574 microversion: 2.1 time: 0.148649 Jun 27 09:50:24.482303 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 559/1143] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:50:24 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:50:25.499489 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-3388c2be-429f-4efd-9cc0-8da5770810c8 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:50:25.500200 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-3388c2be-429f-4efd-9cc0-8da5770810c8 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:50:25.507615 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3388c2be-429f-4efd-9cc0-8da5770810c8 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:25.508060 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3388c2be-429f-4efd-9cc0-8da5770810c8 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:25.508811 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3388c2be-429f-4efd-9cc0-8da5770810c8 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:50:25.509240 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-3388c2be-429f-4efd-9cc0-8da5770810c8 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:50:25.638236 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-3388c2be-429f-4efd-9cc0-8da5770810c8 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:50:25.645627 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-3388c2be-429f-4efd-9cc0-8da5770810c8 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1561 microversion: 2.1 time: 0.150845 Jun 27 09:50:25.646188 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 585/1144] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:50:25 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:51:34.555874 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 09:51:34.556453 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Mon Jun 27 09:51:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 09:51:40.034817 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_api:SELECT=34 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:51:40.034817 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG dbcounter [-] [124869] Writing DB stats nova_cell1:SELECT=6 {{(pid=124869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:51:40.035786 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-70673bb6-472c-4a2e-a117-727a0a685390 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:51:40.037558 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-70673bb6-472c-4a2e-a117-727a0a685390 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:51:40.038170 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-3bdf9468-0514-4e65-8e76-8f950ce5fbae req-b61fa71a-dc56-473c-9b82-7df03bac706b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "526bfd18-438f-40ca-a0a2-23590d5712c2", "tag": "9d599bda-d36b-48fc-9462-bc44070afb0c"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:51:40.041408 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_api:SELECT=30 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:51:40.042207 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG dbcounter [-] [124870] Writing DB stats nova_cell1:SELECT=90 {{(pid=124870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 09:51:40.046621 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-3bdf9468-0514-4e65-8e76-8f950ce5fbae req-b61fa71a-dc56-473c-9b82-7df03bac706b service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:51:40.046999 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-70673bb6-472c-4a2e-a117-727a0a685390 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:51:40.047562 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-3bdf9468-0514-4e65-8e76-8f950ce5fbae req-b61fa71a-dc56-473c-9b82-7df03bac706b service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:51:40.047712 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-70673bb6-472c-4a2e-a117-727a0a685390 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:51:40.048253 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-70673bb6-472c-4a2e-a117-727a0a685390 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:51:40.048686 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-70673bb6-472c-4a2e-a117-727a0a685390 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:51:40.060594 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-3bdf9468-0514-4e65-8e76-8f950ce5fbae req-b61fa71a-dc56-473c-9b82-7df03bac706b service nova] Creating event network-changed:9d599bda-d36b-48fc-9462-bc44070afb0c for instance 526bfd18-438f-40ca-a0a2-23590d5712c2 on hv-cinder-84773 Jun 27 09:51:40.066241 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-3bdf9468-0514-4e65-8e76-8f950ce5fbae req-b61fa71a-dc56-473c-9b82-7df03bac706b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035822 Jun 27 09:51:40.066945 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 586/1145] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 09:51:40.078926 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-70673bb6-472c-4a2e-a117-727a0a685390 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Going to try to terminate instance {{(pid=124870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 09:51:40.429541 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-70673bb6-472c-4a2e-a117-727a0a685390 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "DELETE /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 204 len: 0 microversion: 2.1 time: 0.401340 Jun 27 09:51:40.433521 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 560/1146] 10.222.0.64 () {58 vars in 1238 bytes} [Mon Jun 27 09:51:40 2022] DELETE /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 09:51:40.438979 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-edd1426a-3462-443f-96bc-4f5c2bc5d9f7 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:51:40.440345 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-edd1426a-3462-443f-96bc-4f5c2bc5d9f7 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:51:40.447162 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-edd1426a-3462-443f-96bc-4f5c2bc5d9f7 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:51:40.447651 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-edd1426a-3462-443f-96bc-4f5c2bc5d9f7 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:51:40.448417 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-edd1426a-3462-443f-96bc-4f5c2bc5d9f7 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:51:40.448854 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-edd1426a-3462-443f-96bc-4f5c2bc5d9f7 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:51:40.641636 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-edd1426a-3462-443f-96bc-4f5c2bc5d9f7 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:51:40.649873 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-edd1426a-3462-443f-96bc-4f5c2bc5d9f7 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1567 microversion: 2.1 time: 0.215054 Jun 27 09:51:40.650415 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 587/1147] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:51:40 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 09:51:41.666912 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-6779dae7-4056-48ce-8450-be3c5896c418 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:51:41.667739 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-6779dae7-4056-48ce-8450-be3c5896c418 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:51:41.674668 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6779dae7-4056-48ce-8450-be3c5896c418 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:51:41.675115 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6779dae7-4056-48ce-8450-be3c5896c418 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:51:41.675967 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6779dae7-4056-48ce-8450-be3c5896c418 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:51:41.676361 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-6779dae7-4056-48ce-8450-be3c5896c418 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:51:41.856904 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-6779dae7-4056-48ce-8450-be3c5896c418 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:51:41.864585 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-6779dae7-4056-48ce-8450-be3c5896c418 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1567 microversion: 2.1 time: 0.202045 Jun 27 09:51:41.865135 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 561/1148] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:51:41 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:51:42.732213 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [req-4028ff3b-1e9a-486a-ba68-2a580e63dcaf req-9849838d-dfd5-4f9f-a9c0-3191bdd51359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "526bfd18-438f-40ca-a0a2-23590d5712c2", "name": "network-vif-deleted", "tag": "9d599bda-d36b-48fc-9462-bc44070afb0c"}]} {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 09:51:42.741430 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-4028ff3b-1e9a-486a-ba68-2a580e63dcaf req-9849838d-dfd5-4f9f-a9c0-3191bdd51359 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:51:42.741873 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [req-4028ff3b-1e9a-486a-ba68-2a580e63dcaf req-9849838d-dfd5-4f9f-a9c0-3191bdd51359 service nova] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:51:42.753357 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.compute.server_external_events [req-4028ff3b-1e9a-486a-ba68-2a580e63dcaf req-9849838d-dfd5-4f9f-a9c0-3191bdd51359 service nova] Creating event network-vif-deleted:9d599bda-d36b-48fc-9462-bc44070afb0c for instance 526bfd18-438f-40ca-a0a2-23590d5712c2 on hv-cinder-84773 Jun 27 09:51:42.758350 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [req-4028ff3b-1e9a-486a-ba68-2a580e63dcaf req-9849838d-dfd5-4f9f-a9c0-3191bdd51359 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029927 Jun 27 09:51:42.758927 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 588/1149] 10.222.0.64 () {64 vars in 1317 bytes} [Mon Jun 27 09:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 09:51:42.882135 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-11af27c4-0111-435b-bbfe-844aae7ec388 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:51:42.882684 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-11af27c4-0111-435b-bbfe-844aae7ec388 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:51:42.889511 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-11af27c4-0111-435b-bbfe-844aae7ec388 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:51:42.889968 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-11af27c4-0111-435b-bbfe-844aae7ec388 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:51:42.890743 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-11af27c4-0111-435b-bbfe-844aae7ec388 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:51:42.891221 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-11af27c4-0111-435b-bbfe-844aae7ec388 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:51:42.953674 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.policy [None req-11af27c4-0111-435b-bbfe-844aae7ec388 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124870) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:51:42.961155 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-11af27c4-0111-435b-bbfe-844aae7ec388 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1219 microversion: 2.1 time: 0.083125 Jun 27 09:51:42.961715 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 562/1150] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:51:42 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:51:43.978541 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-65906e6b-c4b0-4bdd-ba05-ad51aaab73b5 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:51:43.979245 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.compute.api [None req-65906e6b-c4b0-4bdd-ba05-ad51aaab73b5 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124869) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:51:43.985531 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-65906e6b-c4b0-4bdd-ba05-ad51aaab73b5 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:51:43.985987 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-65906e6b-c4b0-4bdd-ba05-ad51aaab73b5 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:51:43.987383 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-65906e6b-c4b0-4bdd-ba05-ad51aaab73b5 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:51:43.987855 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-65906e6b-c4b0-4bdd-ba05-ad51aaab73b5 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:51:44.019552 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-65906e6b-c4b0-4bdd-ba05-ad51aaab73b5 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:51:44.020024 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG oslo_concurrency.lockutils [None req-65906e6b-c4b0-4bdd-ba05-ad51aaab73b5 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:51:44.020476 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.objects.instance [None req-65906e6b-c4b0-4bdd-ba05-ad51aaab73b5 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lazy-loading 'fault' on Instance uuid 526bfd18-438f-40ca-a0a2-23590d5712c2 {{(pid=124869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 09:51:44.061772 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.policy [None req-65906e6b-c4b0-4bdd-ba05-ad51aaab73b5 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca82a093a28f40f8a2bfc1f93df03493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf6354961eda4916a8324508b45a98d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124869) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 09:51:44.069798 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-65906e6b-c4b0-4bdd-ba05-ad51aaab73b5 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 200 len: 1224 microversion: 2.1 time: 0.096030 Jun 27 09:51:44.070365 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 589/1151] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:51:43 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 09:51:45.087471 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e991a781-a050-46a8-9f72-197ced6c0591 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '>' {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:51:45.088099 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.compute.api [None req-e991a781-a050-46a8-9f72-197ced6c0591 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [instance: 526bfd18-438f-40ca-a0a2-23590d5712c2] Fetching instance by UUID {{(pid=124870) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 09:51:45.094498 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e991a781-a050-46a8-9f72-197ced6c0591 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:51:45.094942 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e991a781-a050-46a8-9f72-197ced6c0591 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:51:45.095730 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e991a781-a050-46a8-9f72-197ced6c0591 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 09:51:45.096231 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG oslo_concurrency.lockutils [None req-e991a781-a050-46a8-9f72-197ced6c0591 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Lock "75b3599f-e531-4aef-9894-8ae95c783344" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 09:51:45.109073 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.wsgi [None req-e991a781-a050-46a8-9f72-197ced6c0591 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] HTTP exception thrown: Instance 526bfd18-438f-40ca-a0a2-23590d5712c2 could not be found. Jun 27 09:51:45.110665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e991a781-a050-46a8-9f72-197ced6c0591 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Request method failure captured: Jun 27 09:51:45.110665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: request: GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 HTTP/1.1 Jun 27 09:51:45.110665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept: application/json Jun 27 09:51:45.110665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Accept-Encoding: identity Jun 27 09:51:45.110665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Connection: close Jun 27 09:51:45.110665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Length: 0 Jun 27 09:51:45.110665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Content-Type: application/json Jun 27 09:51:45.110665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Host: 10.222.0.64 Jun 27 09:51:45.110665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Openstack-System-Scope: None Jun 27 09:51:45.110665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: User-Agent: python-urllib3/1.26.9 Jun 27 09:51:45.110665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Auth-Token: gAAAAABiuXyZzHhpqLcf2b4B-kIHX5UNX4KeimsZ9fDtgmq0TcrNbnveM_KgIonb_WMvEUjO3Ramy6m4ou_syCUA0sv2i5v5sGeoX5AdPEVNT39xTTkIMEsXJS2FwhpQoTUHVPz6FRNVOhT-vzow4PsoLDq1YQHF69f1COlaWEobGuQ2jIbqY7M Jun 27 09:51:45.110665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Id: None Jun 27 09:51:45.110665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Domain-Name: None Jun 27 09:51:45.110665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Identity-Status: Confirmed Jun 27 09:51:45.110665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Is-Admin-Project: True Jun 27 09:51:45.110665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Id: default Jun 27 09:51:45.110665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Domain-Name: Default Jun 27 09:51:45.110665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Id: cf6354961eda4916a8324508b45a98d5 Jun 27 09:51:45.110665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Project-Name: tempest-TestShelveInstance-704817079 Jun 27 09:51:45.110665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Role: reader,member Jun 27 09:51:45.110665 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Roles: reader,member Jun 27 09:51:45.112585 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cf6354961eda4916a8324508b45a98d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cf6354961eda4916a8324508b45a98d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cf6354961eda4916a8324508b45a98d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cf6354961eda4916a8324508b45a98d5", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}] Jun 27 09:51:45.112585 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant: tempest-TestShelveInstance-704817079 Jun 27 09:51:45.112585 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Id: cf6354961eda4916a8324508b45a98d5 Jun 27 09:51:45.112585 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-Tenant-Name: tempest-TestShelveInstance-704817079 Jun 27 09:51:45.112585 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User: tempest-TestShelveInstance-704817079-project Jun 27 09:51:45.112585 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Id: default Jun 27 09:51:45.112585 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Domain-Name: Default Jun 27 09:51:45.112585 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Id: ca82a093a28f40f8a2bfc1f93df03493 Jun 27 09:51:45.112585 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: X-User-Name: tempest-TestShelveInstance-704817079-project Jun 27 09:51:45.112585 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: method: > Jun 27 09:51:45.112585 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: exception: Instance 526bfd18-438f-40ca-a0a2-23590d5712c2 could not be found. Jun 27 09:51:45.112585 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: action_args: {'id': '526bfd18-438f-40ca-a0a2-23590d5712c2'} Jun 27 09:51:45.113751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: {{(pid=124870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 09:51:45.113751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:51:45.113751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 09:51:45.113751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 09:51:45.113751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 09:51:45.113751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 09:51:45.113751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 09:51:45.113751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 09:51:45.113751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 09:51:45.113751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 09:51:45.113751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 526bfd18-438f-40ca-a0a2-23590d5712c2 could not be found. Jun 27 09:51:45.113751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:51:45.113751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:51:45.113751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:51:45.113751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:51:45.113751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:51:45.113751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:51:45.113751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 09:51:45.113751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 09:51:45.113751 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 09:51:45.115489 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 09:51:45.115489 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 09:51:45.115489 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 09:51:45.115489 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 09:51:45.115489 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 09:51:45.115489 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 09:51:45.115489 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 09:51:45.115489 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 526bfd18-438f-40ca-a0a2-23590d5712c2 could not be found. Jun 27 09:51:45.115489 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:51:45.115489 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 09:51:45.115489 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:51:45.115489 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 09:51:45.115489 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 09:51:45.115489 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 09:51:45.115489 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 09:51:45.115489 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 09:51:45.115489 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 526bfd18-438f-40ca-a0a2-23590d5712c2 could not be found. Jun 27 09:51:45.115489 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: ERROR nova.api.openstack.wsgi Jun 27 09:51:45.117043 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: DEBUG nova.api.openstack.wsgi [None req-e991a781-a050-46a8-9f72-197ced6c0591 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Returning 404 to user: Instance 526bfd18-438f-40ca-a0a2-23590d5712c2 could not be found. {{(pid=124870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 09:51:45.117043 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO nova.api.openstack.requestlog [None req-e991a781-a050-46a8-9f72-197ced6c0591 tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2" status: 404 len: 111 microversion: 2.1 time: 0.028447 Jun 27 09:51:45.117043 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: [pid: 124870|app: 0|req: 563/1152] 10.222.0.64 () {58 vars in 1235 bytes} [Mon Jun 27 09:51:45 2022] GET /compute/v2.1/servers/526bfd18-438f-40ca-a0a2-23590d5712c2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 09:51:45.344244 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: DEBUG nova.api.openstack.wsgi [None req-9243f23a-d001-4be0-a7b9-d582bdb6ec6d tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] Calling method '.version_select at 0x7ffa975cfe50>' {{(pid=124869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 09:51:45.348770 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9243f23a-d001-4be0-a7b9-d582bdb6ec6d tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [acf2e109-c9f6-4e04-bc05-0c90aa3754f7] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 27 09:51:46.356914 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO oslo.messaging._drivers.impl_rabbit [None req-9243f23a-d001-4be0-a7b9-d582bdb6ec6d tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] [acf2e109-c9f6-4e04-bc05-0c90aa3754f7] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 55816. Jun 27 09:51:46.426184 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO nova.api.openstack.requestlog [None req-9243f23a-d001-4be0-a7b9-d582bdb6ec6d tempest-TestShelveInstance-704817079 tempest-TestShelveInstance-704817079-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1915703540" status: 202 len: 0 microversion: 2.1 time: 1.085808 Jun 27 09:51:46.426799 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: [pid: 124869|app: 0|req: 590/1153] 10.222.0.64 () {58 vars in 1253 bytes} [Mon Jun 27 09:51:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1915703540 => generated 0 bytes in 1087 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 09:52:58.803039 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 09:52:58.803658 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Mon Jun 27 09:52:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 09:52:59.235800 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 09:52:59.236328 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Mon Jun 27 09:52:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 09:54:30.475632 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 09:54:30.476157 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Mon Jun 27 09:54:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 09:54:53.850563 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 09:54:53.851154 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Mon Jun 27 09:54:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 09:54:54.564061 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 09:54:54.564569 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Mon Jun 27 09:54:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 09:56:18.811261 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 09:56:18.811987 dv-cinder-847730-1-iscsi devstack@n-api.service[124870]: Mon Jun 27 09:56:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 09:56:19.243760 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 09:56:19.244302 dv-cinder-847730-1-iscsi devstack@n-api.service[124869]: Mon Jun 27 09:56:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!